Technical SEO + GEO audits your agents can run
If you already use Crawlie, the crawlie mcp server is the piece that lets your assistant work with it directly. Technical SEO + GEO audits your agents can run.
Crawl any site for broken links, redirects, missing metadata, and 40+ SEO & Generative-Engine checks — with plain-English guidance on every fix. Runs locally, ships a CLI and an MCP server, and costs nothing.
The toolset is worth reading before you wire it up, because it tells you what the integration is really for:
crawl_site — Crawl + audit a whole site (SEO + GEO), returns scores, issues, per-page dataaudit_url — Audit a single pageaudit_urls — Audit an explicit list of pagesexplain_issue — Why a rule matters + how to fix itlist_rules — The full catalogue of checksBecause this one is hosted, setup is mostly authentication — you point your client at the endpoint and approve access. Nothing runs on your machine, so there is no runtime to keep patched.
This sits in the search and retrieval group, where several servers overlap in what they claim to do but differ sharply once you actually set them up. Crawlie's toolset — crawl_site, audit_url, audit_urls and 2 more — is a fair guide to whether it matches your workflow. It is maintained by Crawlie; worth a glance at recent repository activity before you build anything load-bearing on it.
This entry was verified against Crawlie's own documentation before publication; SyncDev keeps the directory reviewed rather than auto-generated.
| Tool | What it does |
|---|---|
| crawl_site | Crawl + audit a whole site (SEO + GEO), returns scores, issues, per-page data |
| audit_url | Audit a single page |
| audit_urls | Audit an explicit list of pages |
| explain_issue | Why a rule matters + how to fix it |
| list_rules | The full catalogue of checks |
{
"mcpServers": {
"crawlie": {
"command": "crawlie-mcp"
}
}
}Configuration as documented by the project. Restart the client after saving.
The simplest web tool that matters — fetch any URL and get model-ready markdown back.
Industrial-strength web extraction — render, scrape, crawl and search entire sites into clean markdown.
Puppeteer-powered browser control that drives pages from the accessibility tree instead of pixels.
Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.
Answers, not links — delegate questions to Perplexity's search-grounded models and get cited responses back.
Put 6,000+ pre-built scrapers at your assistant's fingertips through one MCP endpoint.