Robots-txt-ai-crawler-audit MCP Server

Robots-txt-ai-crawler-audit is an MCP integration. Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI.

Packages and local setup

The published npm package is @readystack/robots-txt-ai-crawler-audit, version 0.1.3. Its declared MCP transport is stdio.

This package has launch arguments in its registry record. Use the maintainer’s configuration for those arguments rather than launching it with only the package name.

Before connecting

Check the maintainer’s instructions for account access, authentication and the supported client configuration. Once connected, inspect the tools your client receives and try a small task that matches the server’s stated purpose. The registry description does not include a verified, complete tool list.

Project and source

View the publisher’s registry entry · Project repository. This profile uses version 0.1.3 from the registry. Registration identifies the publisher namespace; it does not establish that this is a first-party integration for every service it connects.

Browse related search & web scraping MCP servers for tools that cover the same kind of work.