SSyncDev

Webscrape MCP Server

Fetch any URL and get clean Markdown. Web scraping for AI agents.

Local serverstdioPython

What is the Webscrape MCP Server?

Fetch any URL and get clean Markdown. Web scraping for AI agents.

The short version

MCP server that lets AI agents search the web and extract clean Markdown content — no ads, no clutter, just the text your LLM needs.

  • PDF support — URLs ending in .pdf or with application/pdf content-type are auto-detected and text is extracted page by page
  • Readability mode — Pass use_readability=True to webscrape_fetch_url for cleaner article extraction using Mozilla Readability (removes nav, sidebars, ads, comments)
  • JS rendering — Pass js_render=True to render JavaScript-heavy sites with Playwright (headless Chromium). Auto-fallback when httpx gets 403 or empty content
  • Structured data extraction — Pass extract_schema=True to extract JSON-LD, Open Graph, Twitter Cards, meta tags, canonical URLs, and hreflang links
  • Multi-engine search — DuckDuckGo primary, automatic fallback to Google and Bing if DDGS is unavailable
  • Screenshots — Capture page screenshots with configurable viewport, full-page mode, and PNG/JPEG format

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
webscrape_fetch_urlFetch a single URL and return clean Markdown. Supports use_readability, js_render, extract_schema, and auto-detects PDFs
webscrape_batch_fetchFetch up to 5 URLs in parallel. Supports PDF auto-detection, JS rendering, and structured data
webscrape_searchSearch the web (DuckDuckGo → Google → Bing fallback) and scrape results into Markdown
webscrape_screenshotCapture a screenshot of any web page with headless Chromium. Supports PNG/JPEG, viewport sizing, and full-page capture

How to install the Webscrape MCP Server

{
  "mcpServers": {
    "webscrape": {
      "url": "https://webscrape.mcpize.run",
      "headers": {
        "Authorization": "Bearer your-api-key"
      }
    }
  }
}

Configuration as documented by the project. Restart the client after saving.

Example prompts to try

  • “Use Webscrape to webscrape fetch url.”
  • “Use Webscrape to webscrape batch fetch.”
  • “Use Webscrape to webscrape search.”

Frequently asked questions

Fetch any URL and get clean Markdown. Web scraping for AI agents. Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.

Alternatives to the Webscrape MCP Server

Fetch

Official

Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.

Search & Web ScrapingPython★ 63.0k

Firecrawl

Official

Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.

Search & Web ScrapingTypeScript★ 4.6k

A simple MCP Server for controlling Chrome via Puppeteer

A Model Context Protocol (MCP) server that provides browser automation capabilities through Puppeteer with intelligent browser management. This server enables AI assistants to control Chromium…

Browser Automation

FbAdLibraryMCPServer

Build a Model Context Protocol (MCP) server that provides access to Facebook's Ad Library through web scraping. The server should allow clients to

Search & Web Scraping

Xpay Social Media

96 social media scraping tools. Twitter/X, LinkedIn, Instagram, TikTok, Reddit, YouTube.

Social Media & MarketingRemote

IDLE Protocol

Web scraping, inference, DNS, monitoring from residential IPs — pay per request in USDC

Search & Web Scraping