WebScraping.AI MCP Server

Interact with WebScraping.AI for web data extraction and scraping.

Remote serverstreamable-httpPython

What is the WebScraping.AI MCP Server?

WebScraping.AI becomes available to MCP clients through the webscraping.ai mcp server. Interact with WebScraping.AI for web data extraction and scraping.

What WebScraping.AI does

A Model Context Protocol (MCP) server implementation that integrates with WebScraping.AI for web data extraction capabilities — Chromium JavaScript rendering, rotating datacenter/residential/stealth proxies, and AI-powered question answering and structured field extraction on any page.

Key capabilities

  • Question answering about web page content
  • Structured data extraction from web pages
  • HTML content retrieval with JavaScript rendering
  • Plain text extraction from web pages
  • CSS selector-based content extraction
  • Multiple proxy types (datacenter, residential, stealth) with country selection
  • JavaScript rendering using headless Chrome/Chromium
  • Concurrent request management with rate limiting

Practical notes

  • Written in Python.

Recorded tools

  • timeout — Maximum web page retrieval time in ms (15000 by default, maximum is 30000)
  • js_timeout — Maximum JavaScript rendering time in ms (2000 by default)
  • wait_for — CSS selector to wait for before returning the page content
  • proxy — Type of proxy: datacenter, residential, or stealth (residential by default). Use stealth for the most heavily protected sites with advanced anti-bot detection — costs more than residential, see the pricing page.
  • country — Country of the proxy to use (US by default). Supported countries: us, gb, de, it, fr, ca, es, ru, jp, kr, in
  • custom_proxy — Your own proxy URL in "http://user:password@host:port" format
  • device — Type of device emulation. Supported values: desktop, mobile, tablet
  • error_on_404 — Return error on 404 HTTP status on the target page (false by default)
  • error_on_redirect — Return error on redirect on the target page (false by default)
  • js_script — Custom JavaScript code to execute on the target page

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
urlrequired, non-blank; sent as-is).
countryTwo-letter country code of the proxy used to fetch the page, us by default.
transcript_languageCaption language to pick, e.g. en or de. Without it, English is preferred, then the first available track. If the video has no captions in that language, data.t
paramsobject of extra query parameters (string, number or boolean values) sent as-is, for site-specific parameters added after this release. Keys must match [A-Za-z0-

How to install the WebScraping.AI MCP Server

{
  "mcpServers": {
    "mcp-server-webscraping-ai": {
      "command": "npx",
      "args": [
        "-y",
        "webscraping-ai-mcp"
      ],
      "env": {
        "WEBSCRAPING_AI_API_KEY": "YOUR_WEBSCRAPING_AI_API_KEY",
        "WEBSCRAPING_AI_CONCURRENCY_LIMIT": "5",
        "WEBSCRAPING_AI_ENABLE_CONTENT_SANDBOXING": "true"
      }
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Configuration

VariableDescriptionRequired
WEBSCRAPING_AI_API_KEYDeclared in the maintainer’s client configuration.Check documentation
WEBSCRAPING_AI_CONCURRENCY_LIMITDeclared in the maintainer’s client configuration.Check documentation
WEBSCRAPING_AI_ENABLE_CONTENT_SANDBOXINGDeclared in the maintainer’s client configuration.Check documentation

Example prompts to try

  • “Use WebScraping.AI to timeout.”
  • “Use WebScraping.AI to js timeout.”
  • “Use WebScraping.AI to wait for.”

Frequently asked questions

Interact with WebScraping.AI for web data extraction and scraping. Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.