Search & Web Scraping MCP Servers

1,403 published MCP servers in this category · page 1 of 24 · all categories

Search and scraping MCP integrations retrieve web results or page content through their supported interfaces. Use this category when an answer needs current material, a particular page or content rendered by a browser.

Check what was retrieved

Compare a search result snippet with the full source page. Record the source URL and publication or update date when they affect the answer. Some fetchers return server HTML, while browser-based tools can observe a rendered page; neither interface guarantees that every protected or dynamic page is accessible.

Preserve source context

Keep important tables, headings and quoted passages with their source. Verify a critical claim against the original publisher rather than infer it from an incomplete extraction. Choose a narrow retrieval task first so you can see where redirects, pagination or missing content affect the result.

Compare vendor-maintained integrations, inspect hosted servers or return to all MCP categories.

Fetch

Official

Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.

Search & Web ScrapingPython★ 63.0k

Firecrawl

Official

Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.

Search & Web ScrapingTypeScript★ 4.6k

Puppeteer

Official

The original Chromium automation reference server — simple, screenshot-driven browser control.

Browser AutomationTypeScript★ 63.0k

Browser MCP

Puppeteer-powered browser control that drives pages from the accessibility tree instead of pixels.

Browser AutomationRemoteTypeScript★ 38.4k

Playwright

Automates browsers and APIs, enabling Large Language Models (LLMs) to interact with web pages for tasks like screenshot capture and JavaScript

Browser Automation★ 5.6k

Exa

Official

Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.

Search & Web ScrapingRemoteTypeScript★ 2.9k

Perplexity

Official

Answers, not links — delegate questions to Perplexity's search-grounded models and get cited responses back.

Search & Web ScrapingTypeScript★ 1.3k

Apify

Official

Put 6,000+ pre-built scrapers at your assistant's fingertips through one MCP endpoint.

Search & Web ScrapingRemoteTypeScript★ 700

Security Tools

Integrates security testing and penetration testing tools into AI workflows via the Model Context Protocol.

Search & Web Scraping★ 627

Brave Search

Official

Independent-index web search for assistants — fresh results without the Google API maze.

Search & Web ScrapingTypeScript★ 400

Deep Research

Generates comprehensive, well-cited research reports from research questions by elaborating on the question, finding relevant sources, and analyzing

Search & Web ScrapingPython★ 213

Rag Web Browser

Enables AI agents and LLMs to interact with the web and extract information from web pages via the RAG Web Browser Actor.

Browser AutomationRemoteTypeScript★ 208

Tavily

Enables LLMs to perform AI-powered web searches using the Tavily search API.

Search & Web ScrapingPython★ 72

Perplexity Chat

Provides a Python interface to the Perplexity API for querying responses and managing conversations.

Search & Web ScrapingPython★ 66

Playwright Cdp

Automates browser interactions and enables Large Language Models (LLMs) to interact with web pages through Playwright and Chrome DevTools Protocol

Browser Automation★ 51

App Seo Ai

Automates SEO tasks and provides AI-powered optimization by integrating with the Google Ads Keyword Planner API.

Search & Web ScrapingGo★ 48

Chrome Google Search

Enables Claude to perform Google searches and extract webpage content through a controlled Chrome browser instance.

Browser AutomationGo★ 24

Puppeteer

Enables LLMs to interact with web pages by providing browser automation capabilities, including screenshot capture and JavaScript execution.

Browser AutomationPython★ 17

Perplexity

Provides intelligent code analysis and debugging capabilities by integrating Perplexity AI's API with the Claude desktop client.

Developer ToolsPython★ 14

Wikipedia Image Crawler

Searches and retrieves images from Wikipedia Commons, ensuring adherence to Creative Commons licenses.

Search & Web Scraping★ 10

Doc Scraper

Scrapes web-based documentation and converts it into markdown format.

Search & Web ScrapingPython★ 9

Scraper.Is

Integrates Scraper.is with the Model Context Protocol (MCP) for web scraping capabilities in AI assistants.

Search & Web Scraping★ 8

Exa

Enables AI-powered code search using the Exa API within an MCP environment.

Search & Web Scraping★ 3

Fetch

Retrieves web content in various formats via HTTP.

Search & Web ScrapingTypeScript★ 3

Url Fetch

Enables Claude or any LLM to fetch content from URLs.

Search & Web ScrapingPython★ 3

Fetch

Retrieves and converts web content into various formats.

Search & Web ScrapingTypeScript★ 2

Firecrawl

Enables web scraping, content searching, site crawling, and data extraction using the Firecrawl API.

Search & Web ScrapingTypeScript★ 2

Firecrawl

Scrapes websites and extracts structured data using Firecrawl's APIs.

Search & Web Scraping★ 2

Steel Puppeteer

Automates browser interactions for LLMs using Puppeteer and the Model Context Protocol.

Browser Automation★ 2

App Seo Ai

Automates SEO tasks and provides AI-powered optimization with Google Ads Keyword Planner integration.

Search & Web ScrapingGo★ 1

MCP Math and Web Search Examples

This repository provides local Python MCP examples for arithmetic, DuckDuckGo search and page retrieval, alongside a Groq-powered host.

Search & Web ScrapingPython★ 1

1cent Web Intelligence for AI Agents

SSRF-safe web intelligence: 4 outcomes, 43 paid x402 tools, 3 free tools and a URL preview.

Search & Web ScrapingRemote

302 Web Search MCP

A Model Context Protocol server

Search & Web Scraping

402registry

Does an AI crawler see your site? Free registry lookup, x402 pricing; checks paid in USDC on Base.

Search & Web ScrapingRemote

4fetch

Fetch a URL and get clean Markdown with metadata. No API key required; rate-limited per IP.

Search & Web ScrapingRemote

Aayat AI

AI agent tools: crypto token safety, web search with cited answers, live library docs. Free trial.

Search & Web ScrapingRemote

Academia MCP

MCP server with tools to search, fetch, analyze, and report on scientific papers and datasets.

Search & Web ScrapingPython

Accessibility Hub

# AccesibilityHub MCP Server for orchestrating web accessibility tools (axe-core, Pa11y, Lighthouse). Analyze web pages, check color contrast, get

Accessibility & Interface Audits

Acrawl

Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.

Developer Tools

ActableSite AI Crawler Monitor

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Search & Web ScrapingRemote

Adology Content Intelligence MCP

Adology connects assistants to a workspace for competitive-ad research, brand portfolios, creative analysis and data exports.

Analytics & ReportingRemoteGo

Aeo

AEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.

Search & Web Scraping

AEO Audit

AEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.

Search & Web ScrapingRemote

Aeonos

AI search visibility MCP. Get cited by ChatGPT, Perplexity, Claude, and Google AI Overviews.

Search & Web Scraping

Aetheris

x402-gated web scraping MCP server. Pay 0.01 USDC per page on Base. Returns clean Markdown via JSDOM

Search & Web ScrapingGo

AfterImage

Shared copies of public web pages for AI agents. Search stored pages or fetch a URL.

Search & Web ScrapingRemote

Agentaeo

AEO audit tool — measure brand visibility across ChatGPT, Perplexity, Claude, and Google AI.

Search & Web Scraping

Agentbuilt

Free AI-readiness audit of any URL: AI crawler rules, JS-free text, JSON-LD, llms.txt. Tool catalog.

Search & Web ScrapingRemote

Agentdata-nl

x402-paid tools: EU company & sanctions data, web search, LLM chat, crypto intel, x402 monitoring.

Search & Web ScrapingRemote

Agentdiet

Strips 85-97% of HTML bloat into clean Markdown, <200-token skeletons, or BM25 excerpts via MCP.

Developer ToolsRemote

Agentfetch

Token-budgeted web fetch for AI agents — auto-routes Jina, FireCrawl, Trafilatura, PDF.

Search & Web ScrapingRemotePython

Agent Hub

48 pay-per-call tools: search, scraping, PDF, OCR, LLM, crypto, DeFi, SEC. x402 USDC.

Documents & PDFsRemote

AgenticTotem Web Extractor

AI web extraction: send URLs + a JSON Schema, get clean structured data. Pay-per-use via x402.

Data Processing & ConversionRemote

AgentIndex x402

Jev-powered decisions, web search, PDF/web to Markdown, summarize. From $0.001, no API key.

Search & Web ScrapingRemote

AgentMart Procurement

Procure, compare, quote, budget, and execute web extraction or scraping across providers for agents

Search & Web ScrapingRemote

Agent News

Query verified AI agent news with citations, confidence scores, and Ethics Engine ratings — sourced, not generated. Use instead of generic web search

Search & Web Scraping

Agent Newsstand

Market data and web intelligence for AI agents, paid per call in USDC on Base via x402.

Finance & Market DataRemote

AgentObserver - Check x402 Dependencies Before Paying

Check Exa, BlockRun, OneSource, Apify and other x402 dependencies before invoking or paying.

Search & Web ScrapingRemote

Agentpay

Agents spend money. Most don't know how much, or why, until the session ends and the bill arrives.

Search & Web ScrapingPython

AgentQL

Enable AI agents to get structured data from unstructured web with AgentQL.

Search & Web ScrapingGo

More MCP server categories

Browser Automation (984)Databases (2205)Developer Tools (8565)File Systems & Storage (598)Communication (2659)Productivity & Project Management (1883)AI & ML Services (1983)Cloud & DevOps (1735)Payments & Commerce (2501)Monitoring & Observability (1236)Knowledge & Memory (1603)Design & Creative Tools (327)Analytics & Reporting (965)CI/CD & Build Pipelines (67)Customer Support & Help Centers (74)Documentation & API References (937)Workflow Automation (124)Security & Identity (310)Finance & Market Data (1303)CRM & Sales (561)Social Media & Marketing (1525)Research & Scientific Computing (317)Maps & Location (392)Media & Entertainment (908)Education & Learning (107)Healthcare & Life Sciences (243)Travel & Hospitality (391)Hardware & IoT (205)Blockchain & Web3 (1068)Data Processing & Conversion (626)Legal & Compliance (1194)Government & Public Data (825)Weather & Environment (712)Sports & Fitness (322)Real Estate & Property (383)Games & Game Development (242)Time & Date (400)Accessibility & Interface Audits (172)Content Management (155)Mobile Development (259)Human Resources & Recruiting (238)News & Events (577)SEO & Website Audits (560)Software Testing & QA (127)Git & Version Control (832)Code Execution & Sandboxes (112)Terminal & Desktop Automation (123)Email & Inbox Management (676)Calendars & Scheduling (456)Documents & PDFs (966)Spreadsheets (253)Presentations & Slides (93)Vector Search & RAG (358)AI Agents & Orchestration (329)Images & Visual Editing (315)Audio & Speech (254)Video Tools (781)Translation & Localization (160)Diagrams & Whiteboards (233)Data Engineering & ETL (51)Math & Calculations (400)Networking & Diagnostics (247)Food & Recipes (286)Logistics & Shipping (199)Advertising & PPC (182)Accounting & Bookkeeping (172)E-commerce & Online Stores (308)Project & Task Management (381)Notes & Personal Knowledge (184)Meetings & Transcripts (45)API Development & Testing (216)Code Search & Intelligence (154)Kubernetes & Containers (269)Infrastructure as Code (48)Identity & Access Management (30)Secrets & Credentials (21)Feature Flags & Experiments (27)Incident & On-call Management (33)Web & Product Analytics (133)Email Marketing (46)Forms & Surveys (17)E-signatures & Agreements (43)Time Tracking & Timesheets (95)Business Intelligence & Dashboards (60)Other Integrations (20690)