The fastest web crawling, scraping, and browser automation server for AI agents. Gives Claude direct access to the web through 21 tools — crawl sites at 100K+ pages/sec, extract structured data with…
spider-cloud-mcp-v2 is an MCP project maintained in the spider-rs/spider-cloud-mcp-v2 repository. The maintainer describes its purpose as “The fastest web crawling, scraping, and browser automation server for AI agents. Gives Claude direct access to the web through 21 tools — crawl sites…”. Read the project documentation for the complete scope.
The documented npm package is spider-cloud-mcp. The configuration below comes from the maintainer’s example; adapt its paths and account values to your environment.
The example declares SPIDER_API_KEY. Secret-looking values have been replaced with placeholders. Required and optional labels are shown only when the documentation states them.
Project documentation · Repository · Discovery listing. This profile records the public documentation checked on 2026-10-08.
Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.
| Tool | What it does |
|---|---|
| spider_crawl | Crawl a website and extract content from multiple pages. Follows links up to a depth/limit. |
| spider_scrape | Scrape a single page. Faster and cheaper than crawling when you need one URL. |
| spider_search | Search the web. Optionally fetch full page content from results. |
| spider_links | Extract all links from a page without fetching content. |
| spider_screenshot | Capture a page screenshot as base64 PNG. |
| spider_transform | Convert HTML to markdown or text without making web requests. |
| spider_get_credits | Check your API credit balance. |
| spider_ai_crawl | AI-guided crawling — describe what content to find. |
| spider_ai_scrape | Extract structured data with plain English — no CSS selectors. |
| spider_ai_search | AI-enhanced search with intent understanding. |
| spider_ai_browser | Automate browser actions with natural language. |
| spider_ai_links | Find and filter links by description. |
| spider_browser_open | Open a remote browser session. Returns a session_id. |
| spider_browser_navigate | Navigate to a URL and wait for load. |
| spider_browser_click | Click an element by CSS selector. |
| spider_browser_fill | Fill a form field with text. |
| spider_browser_screenshot | Take a screenshot of the current page. Returns base64 PNG. |
| spider_browser_content | Get page HTML or visible text. |
| spider_browser_evaluate | Execute JavaScript in the page context. |
| spider_browser_wait_for | Wait for an element, navigation, or network idle. |
| spider_browser_close | Close the session and stop billing. |
{
"mcpServers": {
"spider": {
"command": "npx",
"args": [
"-y",
"spider-cloud-mcp"
],
"env": {
"SPIDER_API_KEY": "YOUR_SPIDER_API_KEY"
}
}
}
}From the project documentation. Replace placeholders and example paths before connecting.
| Variable | Description | Required |
|---|---|---|
| SPIDER_API_KEY | Declared in the maintainer’s client configuration. | Yes |
Use Microsoft’s Playwright MCP server to navigate pages, inspect accessibility snapshots, fill forms and capture browser screenshots.
The original Chromium automation reference server — simple, screenshot-driven browser control.
OR install globally with `pip`: ```bash pip install computer-control-mcp ``` Then run the server with: ```bash computer-control-mcp # instead of uvx
Agent-built web app quality gate. Real browser is the judge. PASS/FAIL with receipts.
A Model Context Protocol server for automating browser tasks using Browser Use API. This server provides tools to run browser automation tasks, monitor task status, and manage running tasks.
Enable your code gen agents to create & run 0-config end-to-end tests against new code changes in remote browsers via the Debugg AI testing platform.