Robots-txt-checker MCP Server

Robots-txt-checker is an MCP integration. Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Hosted connection

The registry lists a streamable-http connection at https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp.

Before connecting

Check the maintainer’s instructions for account access, authentication and the supported client configuration. Once connected, inspect the tools your client receives and try a small task that matches the server’s stated purpose. The registry description does not include a verified, complete tool list.

Project and source

View the publisher’s registry entry. This profile uses version 1.0.93057 from the registry. Registration identifies the publisher namespace; it does not establish that this is a first-party integration for every service it connects.

Browse related developer tools MCP servers for tools that cover the same kind of work.