Webscrape MCP Server

Fetch any URL and get clean Markdown. Web scraping for AI agents. That is what the webscrape mcp server brings to an AI assistant: the same capability, reachable through the Model Context Protocol rather than a separate app or dashboard.

The short version

MCP server that lets AI agents search the web and extract clean Markdown content — no ads, no clutter, just the text your LLM needs.

• PDF support — URLs ending in .pdf or with application/pdf content-type are auto-detected and text is extracted page by page
• Readability mode — Pass use_readability=True to webscrape_fetch_url for cleaner article extraction using Mozilla Readability (removes nav, sidebars, ads, comments)
• JS rendering — Pass js_render=True to render JavaScript-heavy sites with Playwright (headless Chromium). Auto-fallback when httpx gets 403 or empty content
• Structured data extraction — Pass extract_schema=True to extract JSON-LD, Open Graph, Twitter Cards, meta tags, canonical URLs, and hreflang links
• Multi-engine search — DuckDuckGo primary, automatic fallback to Google and Bing if DDGS is unavailable
• Screenshots — Capture page screenshots with configurable viewport, full-page mode, and PNG/JPEG format

The tools it exposes

The server publishes 9 tools. What each one is for:

• webscrape_fetch_url — Fetch a single URL and return clean Markdown. Supports use_readability, js_render, extract_schema, and auto-detects PDFs
• webscrape_batch_fetch — Fetch up to 5 URLs in parallel. Supports PDF auto-detection, JS rendering, and structured data
• webscrape_search — Search the web (DuckDuckGo → Google → Bing fallback) and scrape results into Markdown
• webscrape_screenshot — Capture a screenshot of any web page with headless Chromium. Supports PNG/JPEG, viewport sizing, and full-page capture
• Tools — The Tools tool exposed by this server
• Features — The Features tool exposed by this server
• Dependencies — The Dependencies tool exposed by this server
• Dependencias — The Dependencias tool exposed by this server
• Licencia — The Licencia tool exposed by this server

Getting it running

Setup follows the usual MCP pattern — install or clone the server, register it in your client's configuration file, restart the client. The configuration blocks on this page cover the common clients.

How it compares

This sits in the browser automation group, where several servers overlap in what they claim to do but differ sharply once you actually set them up. Webscrape's toolset — webscrape_fetch_url, webscrape_batch_fetch, webscrape_search and 6 more — is a fair guide to whether it matches your workflow. It is maintained by carrasquelalex1; worth a glance at recent repository activity before you build anything load-bearing on it.

We check each listing at SyncDev against the project's documentation before it goes live — if something here drifts out of date, it is a bug worth reporting.

Things to watch

• It runs with your machine's permissions. That is convenient and also the reason to think about what you point it at before you approve a tool call.
• With 9 tools registered it takes up a noticeable share of the context window; turn it off in projects that never touch Webscrape.
• Keep per-call confirmation enabled while you learn its behaviour; it is the cheapest safeguard you have.