Cloudflare Workers MCP server: ai-crawler-policy
Ai-crawler-policy is an MCP integration. Cloudflare Workers MCP server: ai-crawler-policy.
The registry lists a streamable-http connection at https://api.lazy-mac.com/ai-crawler-policy/mcp.
Check the maintainer’s instructions for account access, authentication and the supported client configuration. Once connected, inspect the tools your client receives and try a small task that matches the server’s stated purpose. The registry description does not include a verified, complete tool list.
View the publisher’s registry entry · Project repository. This profile uses version 1.0.0 from the registry. Registration identifies the publisher namespace; it does not establish that this is a first-party integration for every service it connects.
Browse related search & web scraping MCP servers for tools that cover the same kind of work.
Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.
Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.
Web scraping, Google SERP, Markdown and ChatGPT/Gemini answers as typed tools for AI agents.
DISCONTINUED 2026-05-23. Indeed.com Cloudflare + DataDome anti-bot returns HTTP 403 on all scraping
The MCP server of Banquish, for any MCP client.
Essential MCP server: HTTP, web search, downloads, Wolfram|Alpha, shell, JS, file I/O, memory.