Scrape a page

Turn any page into clean, LLM-ready markdown — same format as Firecrawl's /v2/scrape.

Paste a URL to see its markdown, HTML, links and metadata.

Map a site

List a website's URLs from its sitemaps, its links and a site search — fast, nothing is scraped.

Enter a site to see its pages.

Crawl a site

Scrape every page below a URL in the background, following links and sitemaps and respecting robots.txt.

AI extract & research

Turn pages into structured JSON, or let an agent search and read the web to answer a question. Uses this node's LLM only.

Settings

Configure this node. Changes apply immediately and are saved on this node only.

Node access (API key)

Decides who can use this node: the web UI, the Firecrawl SDKs and MCP all need it. Peers in the network never use it — they connect with the network key. Anyone with this key can run searches and use your AI credits, so share it only with your own devices and apps.

To change the key, set HC_API_KEYS in the node's .env and run docker compose up -d.

AI model (LLM)

This is a different key: your account with an AI provider. It stays on this node and is never shown again after saving. Used for Extract, Agent and the AI scrape formats — only for requests made with this node's API key, never for other nodes in the network. Works with Anthropic (Claude) and any OpenAI-compatible API.

Updates

Version
—
Latest release
—
Last checked
—
Last updated
—
Auto-update
—

Network

This node, its engines, and the peers it trades searches with. Refreshes every 5 seconds.

Engines

Peers

NodeRouteStatusAnsweredAsked / servedPriorityAgreementLatencyOnline

Connect

Use this node from code, Firecrawl SDKs, or AI agents over MCP.

API URL
API key

Sign in to your node

This HiveCrawl node is private: only someone with its key can use it. You do this once per browser.

1
On the machine running the node, in the hivecrawl folder, run:
docker compose exec hivecrawl /hivecrawl login
It prints a sign-in link and the key.
2
Open the link it prints, or paste the key here:
The key is kept only in this browser. You can sign out later in Settings.
Other places to find the key

If you set HC_API_KEYS in the node's .env, use that value (grep HC_API_KEYS .env). Otherwise the node made one on first start and saved it in its data volume; the command above prints it, and the first start's log shows it too (docker compose logs hivecrawl | grep sign).