With this MCP server, you can scrape anything and then use that knowledge anywhere for RAG.
mcp-crawl4ai-rag is an MCP project maintained in the coleam00/mcp-crawl4ai-rag repository. The maintainer describes its purpose as “With this MCP server, you can scrape anything and then use that knowledge anywhere for RAG”. Read the project documentation for the complete scope.
The maintainer’s configuration uses http://localhost:8051/sse. It declares sse transport. Check the project’s account and authentication instructions when adding the endpoint to your client.
Project documentation · Repository · Discovery listing. This profile records the public documentation checked on 2026-10-08.
{
"mcpServers": {
"crawl4ai-rag": {
"transport": "sse",
"url": "http://localhost:8051/sse"
}
}
}From the project documentation. Replace placeholders and example paths before connecting.
Official Redis server — search keys, inspect data structures and manage caches in natural language.
Enables AI agents and LLMs to interact with the web and extract information from web pages via the RAG Web Browser Actor.
Enables semantic search and retrieval of documentation using a vector database, allowing users to add and query documentation from URLs or local
Augments AI responses with relevant documentation context through vector search.
Augment AI responses with context by retrieving and processing documentation through vector search.
Enables semantic analysis of chat conversations through vector embeddings and knowledge graphs.