How do I install the crawlforge mcp mcp server?

Use a recorded configuration for your client, replace example credential values and paths, and verify the documented runtime. Restart or reconnect the client, then inspect the available tools.

What credentials does it need?

It reads `CRAWLFORGE_API_KEY`, `CRAWLFORGE_API_URL`, `OLLAMA_BASE_URL`, `OLLAMA_DEFAULT_MODEL`, `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, `CRAWLFORGE_TOOLS`, `CRAWLFORGE_TOOL_GROUPS` from the environment. Store these in your client's env block or a secrets manager — never commit them to a repository — and grant the narrowest scope that still covers your use case.

SSyncDev

Start a project

CrawlForge MCP Server

CrawlForge MCP is a production-ready MCP server with 18 web scraping tools for AI agents. It gives Claude, Cursor, and any MCP-compatible client the

Remote serverstreamable-http

What is the CrawlForge MCP Server?

CrawlForge MCP is a production-ready MCP server with 18 web scraping tools for AI agents. It gives Claude, Cursor, and any MCP-compatible client the ability to

What the server does

27 web scraping, crawling, deep-research & autonomous-extraction tools for Claude, Cursor & any MCP client.

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

Tool	What it does
fetch_url	1
extract_text	1
extract_links	1
extract_metadata	1
scrape_template	1
list_ollama_models	1
get_batch_results	1
scrape	2
scrape_structured	2
extract_content	2
map_site	2
process_document	2
localization	2

How to install the CrawlForge MCP Server

{
  "mcpServers": {
    "crawlforge-mcp-git": {
      "command": "npx",
      "args": ["-y", "crawlforge-setup"],
      "env": {
        "CRAWLFORGE_API_KEY": "your-value",
        "CRAWLFORGE_API_URL": "your-value",
        "OLLAMA_BASE_URL": "your-value",
        "OLLAMA_DEFAULT_MODEL": "your-value",
        "OPENAI_API_KEY": "your-value",
        "ANTHROPIC_API_KEY": "your-value",
        "CRAWLFORGE_TOOLS": "your-value",
        "CRAWLFORGE_TOOL_GROUPS": "your-value"
      }
    }
  }
}

Add to claude_desktop_config.json, then restart Claude Desktop.

Configuration

Variable	Description	Required
CRAWLFORGE_API_KEY	Credential the server authenticates with.	Yes
CRAWLFORGE_API_URL	Endpoint or connection string the server talks to.	Yes
OLLAMA_BASE_URL	Endpoint or connection string the server talks to.	Yes
OLLAMA_DEFAULT_MODEL	Configuration value read at startup.	Optional
OPENAI_API_KEY	Credential the server authenticates with.	Yes
ANTHROPIC_API_KEY	Credential the server authenticates with.	Yes
CRAWLFORGE_TOOLS	Configuration value read at startup.	Optional
CRAWLFORGE_TOOL_GROUPS	Configuration value read at startup.	Optional

Example prompts to try

“Use CrawlForge MCP to Auto.”
“Use CrawlForge MCP to fetch url.”
“Use CrawlForge MCP to extract text.”

Frequently asked questions

CrawlForge MCP is a production-ready MCP server with 18 web scraping tools for AI agents. It gives Claude, Cursor, and any MCP-compatible client the ability to Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.