Crawl websites, export SEO data, and manage crawls via Screaming Frog SEO Spider.
Crawl websites, export SEO data, and manage crawls via Screaming Frog SEO Spider.
A headless MCP (Model Context Protocol) server for Screaming Frog SEO Spider. It drives the SF command line and saved crawl database directly, so Claude (or any MCP-compatible client) can run crawls, export crawl data, and analyze the results with the Screaming Frog GUI closed: on your laptop, on a server, or inside scheduled audits and CI pipelines.
Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.
Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.
| Tool | What it does |
|---|---|
| sf_check | Verify Screaming Frog is installed, check version and license status |
| crawl_site | Start a headless background crawl (see note below) |
| crawl_status | Check progress of a running crawl |
| list_crawls | List all saved crawls with their Database IDs |
| export_crawl | Export crawl data as CSV files (many export options available) |
| read_crawl_data | Read exported CSV data with pagination, filtering, and column selection |
| aggregate_crawl_data | Counts and group-by breakdowns over exported data ("how many 404s", "status code distribution") without reading rows into context |
| delete_crawl | Permanently delete a crawl from the database |
| storage_summary | Show disk usage of SF's crawl storage |
{
"mcpServers": {
"screaming-frog": {
"command": "uvx",
"args": ["screaming-frog-mcp"],
"env": {
"SF_CLI_PATH": "your-value"
}
}
}
}Add to claude_desktop_config.json, then restart Claude Desktop.
| Variable | Description | Required |
|---|---|---|
| SF_CLI_PATH | Filesystem location the server is allowed to use. | Optional |
Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.
Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.
The original Chromium automation reference server — simple, screenshot-driven browser control.
Puppeteer-powered browser control that drives pages from the accessibility tree instead of pixels.
Automates browsers and APIs, enabling Large Language Models (LLMs) to interact with web pages for tasks like screenshot capture and JavaScript
Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.