MCP server tailored to connecting web crawler data and archives
MCP server tailored to connecting web crawler data and archives
Advanced search and retrieval for web crawler data. With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously. The server includes a fulltext search interface with boolean support, and resource filtering by type, HTTP status, and more.
Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.
Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.
| Tool | What it does |
|---|---|
| privacy | fulltext single keyword match |
| boundar | fulltext wildcard matches results starting with *boundar* (boundary, boundaries) |
| url | resource URL |
| type | enumerated list of types (see types table) |
| size | file size in bytes |
| status | HTTP response codes |
| headers | HTTP response headers |
| content | HTTP body—HTML, CSS, JS, and more |
| created | on request |
| modified | on request |
{
"mcpServers": {
"server-webcrawl": {
"command": "uvx",
"args": ["mcp-server-webcrawl"]
}
}
}Add to claude_desktop_config.json, then restart Claude Desktop.
Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.
Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.
MCP server for AnySite — five meta-tools (discover / execute / get_page / query_cache / export_data) over 30+ data sources including LinkedIn
Connect a local stdio MCP client to Pangolinfo VOC Insight MCP. This small bridge forwards tool discovery and calls to the existing hosted service; it does not implement its own scraper or sentiment…
SERP-based content scoring and optimization with 7 SEO categories.
Private context layer for AI agents: web, docs, code search, dep graph, memory, planning.