Industrial-strength web extraction — render, scrape, crawl and search entire sites into clean markdown.
Firecrawl is what you graduate to when simple fetching stops being enough. Its MCP server wraps a hosted extraction platform that renders JavaScript, rotates proxies, retries intelligently and returns clean, LLM-ready markdown — from a single page, a batch of URLs, or an entire site crawled link by link.
The tool spread tells the story. scrape handles one URL with full rendering, so SPAs and lazy-loaded content actually show up. map discovers all the URLs on a site fast — handy on its own for auditing site structure. crawl walks a whole site with depth and page limits and returns everything as markdown, which is how you turn a documentation site into a knowledge base in one command. search runs a web search and optionally scrapes the results in the same call, collapsing the find-then-read loop into one step. And extract pulls structured data — you describe a schema, it returns JSON matching it, from pages that were never meant to be machine-readable.
That last one is quietly the killer feature for real work: "get me name, price and rating for every product on these pages, as JSON" is a data-engineering task that becomes a sentence.
It's a hosted service with credits — the free tier is enough to evaluate honestly, and self-hosting the open-source engine is possible if you'd rather run your own. Against the alternatives: Fetch is free and fine for static pages; Playwright gives you interactive control; Apify has site-specific specialists. Firecrawl's lane is bulk, reliable, rendering-aware extraction with minimal ceremony, and in that lane it's currently the one to beat.
map is cheap; crawl is not. Map the domain first, look at the URL list, then crawl with a limit and path filters set — pointing crawl at a site root and hoping is how people burn a month of credits in an afternoon.onlyMainContent defaults to on and strips nav, sidebars and footers. Switch it off only when the thing you actually want lives in the page chrome — pricing footers, for instance.extract runs a model over each page, so it costs meaningfully more than scrape. If a CSS selector or a regex over the markdown would do, scrape and parse it yourself.Crawl a documentation site into markdown your assistant can answer from.
Product specs, pricing tables and listings extracted as schema-conforming JSON.
Scrape competitor pages that plain fetchers can't render.
| Tool | What it does |
|---|---|
| firecrawl_scrape | Scrape one URL with JS rendering into markdown or HTML |
| firecrawl_map | Discover all URLs on a site quickly |
| firecrawl_crawl | Crawl a whole site with depth/limit controls |
| firecrawl_search | Web search with optional scraping of results |
| firecrawl_extract | Extract structured JSON from pages using a schema or prompt |
claude mcp add firecrawl --env FIRECRAWL_API_KEY=fc-your-key -- npx -y firecrawl-mcpA Firecrawl API key; free credits on signup, usage-based after. Self-hosting the open-source engine is an option.
| Variable | Description | Required |
|---|---|---|
| FIRECRAWL_API_KEY | API key from firecrawl.dev (free credits to start)e.g. fc-... | Yes |
The simplest web tool that matters — fetch any URL and get model-ready markdown back.
Puppeteer-powered browser control that drives pages from the accessibility tree instead of pixels.
Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.
Answers, not links — delegate questions to Perplexity's search-grounded models and get cited responses back.
Put 6,000+ pre-built scrapers at your assistant's fingertips through one MCP endpoint.
Independent-index web search for assistants — fresh results without the Google API maze.