An MCP (Model Context Protocol) server that helps you discover, identify, and govern every bot interacting with your website — search engines, AI crawlers, SEO tools, social-preview fetchers…
Hellogrowthcrmmcp is an MCP project maintained in the keyur-meru/mcp-bot-crawler-hellogrowthcrm repository. The maintainer describes its purpose as “An MCP (Model Context Protocol) server that helps you discover, identify, and govern every bot interacting with your website — search engines, AI crawlers, SEO…”. Read the project documentation for the complete scope.
The project provides a local client configuration using node. Follow the repository’s build and installation steps before copying it, and replace example paths with the paths on your own computer.
The example declares DEFAULT_TARGET_URL, DEFAULT_ACCESS_LOG, CRAWLER_USER_AGENT. Secret-looking values have been replaced with placeholders. Required and optional labels are shown only when the documentation states them.
Project documentation · Repository · Discovery listing. This profile records the public documentation checked on 2026-10-08.
{
"mcpServers": {
"bot-crawler": {
"command": "node",
"args": [
"/absolute/path/to/hellocrmwebsite/mcp-bot-crawler/dist/index.js"
],
"env": {
"DEFAULT_TARGET_URL": "https://hellogrowthcrm.com",
"DEFAULT_ACCESS_LOG": "/var/log/nginx/access.log",
"CRAWLER_USER_AGENT": "mcp-bot-crawler/1.0 (+https://hellogrowthcrm.com/bot-info)"
}
}
}
}From the project documentation. Replace placeholders and example paths before connecting.
| Variable | Description | Required |
|---|---|---|
| DEFAULT_TARGET_URL | Declared in the maintainer’s client configuration. | Check documentation |
| DEFAULT_ACCESS_LOG | Declared in the maintainer’s client configuration. | Check documentation |
| CRAWLER_USER_AGENT | Declared in the maintainer’s client configuration. | Check documentation |
Retrieve public web pages as readable Markdown with the reference Fetch MCP server, including pagination for longer responses.
Use Firecrawl MCP to retrieve website content and extract information for research through Firecrawl’s API-backed web tools.
The original Chromium automation reference server — simple, screenshot-driven browser control.
Puppeteer-powered browser control that drives pages from the accessibility tree instead of pixels.
Automates browsers and APIs, enabling Large Language Models (LLMs) to interact with web pages for tasks like screenshot capture and JavaScript
Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.