How do I install the mcp web scraper mcp server?

Use a recorded configuration for your client, replace example credential values and paths, and verify the documented runtime. Restart or reconnect the client, then inspect the available tools.

What credentials does it need?

It reads `BROWSER_POOL_SIZE`, `DEBUG_LOGGING` from the environment. Store these in your client's env block or a secrets manager — never commit them to a repository — and grant the narrowest scope that still covers your use case.

SSyncDev

Start a project

MCP Web Scraper MCP Server

MCP-compliant web scraper with advanced cookie consent handling

Local serverstdioTypeScript

What is the MCP Web Scraper MCP Server?

MCP-compliant web scraper with advanced cookie consent handling

What it actually does

A production-ready global content extraction platform with ML-powered automation, international site support, and intelligent optimization. Features complete browser automation with 29 tools, 21+ supported sites across 4 regions, 6 content platforms with specialized optimization, and persistent SQLite caching with cross-session learning. Built with TypeScript using the official MCP TypeScript SDK and Playwright.

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

Tool	What it does
scrape_article_content	Extract article content with intelligent cookie consent handling.
get_page_screenshot
handle_cookie_consent
manage_tabs
monitor_network
drag_drop
navigate_history

How to install the MCP Web Scraper MCP Server

{
  "mcpServers": {
    "mcp-web-scraper": {
      "command": "node",
      "args": [
        "/path/to/mcp-web-scraper/dist/server.js"
      ],
      "env": {
        "BROWSER_POOL_SIZE": "3",
        "DEBUG_LOGGING": "true"
      }
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Configuration

Variable	Description	Required
BROWSER_POOL_SIZE	Declared in the maintainer’s client configuration.	Check documentation
DEBUG_LOGGING	Declared in the maintainer’s client configuration.	Check documentation

Example prompts to try

“Use MCP Web Scraper to scrape article content.”
“Use MCP Web Scraper to get page screenshot.”
“Use MCP Web Scraper to handle cookie consent.”

Frequently asked questions

MCP-compliant web scraper with advanced cookie consent handling Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.