Python SDK for CRW web scraper — scrape, crawl, and map any website from Python
Python SDK for CRW web scraper — scrape, crawl, and map any website from Python
The web data API for AI agents — search, scrape, map, and crawl any site into clean markdown or JSON.
Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.
| Variable | Description | Required |
|---|---|---|
| CRW_API_KEY | Credential the server authenticates with. | Yes |
| CRW_API_URL | Endpoint or connection string the server talks to. | Yes |
Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.
Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.
AI visibility: is your brand cited by ChatGPT, Perplexity, Gemini? SoV, GEO score, AI traffic.
Ask Google Search Console in plain language. Hosted, free, no Google Cloud project.
Clean, dedupe and verify Google Maps leads from any scraper.
MCP server for browser automation using Puppeteer with configurable options