How do I install the crawl mcp server?

Use a recorded configuration for your client, replace example credential values and paths, and verify the documented runtime. Restart or reconnect the client, then inspect the available tools.

What credentials does it need?

It reads `CRAWL4AI_LANG` from the environment. Store these in your client's env block or a secrets manager — never commit them to a repository — and grant the narrowest scope that still covers your use case.

SSyncDev

Start a project

Crawl MCP Server

A comprehensive Model Context Protocol (MCP) server that wraps the powerful crawl4ai library with advanced AI capabilities. Extract and analyze

Local serverstdioPython

What is the Crawl MCP Server?

A comprehensive Model Context Protocol (MCP) server that wraps the powerful crawl4ai library with advanced AI capabilities. Extract and analyze content from any

Configuration and credentials

Python 3.11 or later (FastMCP requires Python 3.11+) Install system dependencies for Playwright: Ubuntu 24.04 LTS (Manual Required): ```bash

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

Tool	What it does
crawl_url	Extract web page content with JavaScript support (remote .html/.htm URLs are rendered in the browser; document URLs are converted as files)
deep_crawl_site	Crawl multiple pages from a site with configurable depth (max_depth 1-2, max_pages 1-10)
crawl_url_with_fallback	Crawl with fallback strategies for anti-bot sites
intelligent_extract	Extract specific data from web pages using LLM
extract_entities	Extract entities (emails, phones, etc.) from web pages
extract_structured_data	Extract structured data using CSS selectors or LLM
extract_youtube_transcript	Extract YouTube transcripts with timestamps and timezone-converted publish time (timezone)
batch_extract_youtube_transcripts	Extract transcripts from multiple YouTube videos (max 3)
get_youtube_video_info	Get YouTube video metadata (including published_at in the requested timezone) and transcript availability
extract_youtube_comments	Extract YouTube video comments with pagination
search_google	Search Google with optional genre filtering
batch_search_google	Perform multiple Google searches (max 3)
search_and_crawl	Search Google and crawl top results
get_search_genres	Get available search genres
process_file	Convert PDF, Word, Excel, PowerPoint, ZIP to markdown
get_supported_file_formats	Get supported file formats and capabilities
enhanced_process_large_content	Process large content with chunking and BM25 filtering
batch_crawl	Crawl multiple URLs sequentially with fallback (max 3 URLs)
multi_url_crawl	Multi-URL crawl with pattern-based config (max 5 URL patterns, processed sequentially)

How to install the Crawl MCP Server

{
  "mcpServers": {
    "crawl-mcp": {
      "transport": "stdio",
      "command": "uvx",
      "args": [
        "--from",
        "git+https://github.com/walksoda/crawl-mcp",
        "crawl-mcp"
      ]
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Configuration

Python 3.11 or later (FastMCP requires Python 3.11+) Install system dependencies for Playwright: Ubuntu 24.04 LTS (Manual Required): ```bash

Example prompts to try

“Use Crawl MCP to English.”
“Use Crawl MCP to crawl url.”
“Use Crawl MCP to deep crawl site.”

Frequently asked questions

A comprehensive Model Context Protocol (MCP) server that wraps the powerful crawl4ai library with advanced AI capabilities. Extract and analyze content from **any Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.