How do I install the Crawlab MCP Server?

Use a recorded configuration for your client, replace example credential values and paths, and verify the documented runtime. Restart or reconnect the client, then inspect the available tools.

What are the prerequisites to run the server?

Python 3.8+, a running Crawlab instance, and a valid Crawlab API token. The server connects to Crawlab via its API, so the instance must be accessible.

What credentials does it need?

It reads `SERVER_URL`, `CRAWLAB_API_BASE_URL`, `CRAWLAB_API_TOKEN` from the environment. Store these in your client's env block or a secrets manager — never commit them to a repository — and grant the narrowest scope that still covers your use case.

SSyncDev

Start a project

Crawlab MCP Server

# Crawlab MCP Server This is a Model Context Protocol (MCP) server for Crawlab, allowing AI applications to interact with Crawlab's functionality. ##

Local serverstdioPython

What is the Crawlab MCP Server?

Crawlab MCP Server This is a Model Context Protocol (MCP) server for Crawlab, allowing AI applications to interact with Crawlab's functionality. Overview The

Available tools

The toolset is worth reading before you wire it up, because it tells you what the integration is really for:

Prerequisites — The Prerequisites tool exposed by this server
Configuration — 1. Copy the .env.example file to .env: cp .env.example .env
Resources — The Resources tool exposed by this server
Tools — The Tools tool exposed by this server

Credentials and setup notes

Python 3.8+ - Crawlab instance running and accessible - API token from Crawlab

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

How to install the Crawlab MCP Server

{
  "mcpServers": {
    "crawlab": {
      "command": "uvx",
      "args": ["git"],
      "env": {
        "SERVER_URL": "your-value",
        "CRAWLAB_API_BASE_URL": "your-value",
        "CRAWLAB_API_TOKEN": "your-value"
      }
    }
  }
}

Add to claude_desktop_config.json, then restart Claude Desktop.

Configuration

Python 3.8+ - Crawlab instance running and accessible - API token from Crawlab

Variable	Description	Required
SERVER_URL	Endpoint or connection string the server talks to.	Yes
CRAWLAB_API_BASE_URL	Endpoint or connection string the server talks to.	Yes
CRAWLAB_API_TOKEN	Credential the server authenticates with.	Yes

Example prompts to try

“Use Crawlab to Prerequisites.”
“Use Crawlab to Configuration.”
“Use Crawlab to Resources.”

Frequently asked questions

It is a standard MCP server that translates AI application tool calls into Crawlab API requests, enabling natural‑language control of Crawlab’s spider, task, and file management features.

Alternatives to the Crawlab MCP Server

Puppeteer

Official

The original Chromium automation reference server — simple, screenshot-driven browser control.

Browser AutomationTypeScript★ 63.0k

Fonoster

Build a programmable telecommunications stack for connecting telephony services with the Internet via a cloud-based utility.

AI & ML ServicesTypeScript★ 8.1k

Playwright

Automates browsers and APIs, enabling Large Language Models (LLMs) to interact with web pages for tasks like screenshot capture and JavaScript

Browser Automation★ 5.6k

Cloudflare

Official

Workers, KV, R2 and D1 by conversation — Cloudflare's official remote servers for building and observability.

Cloud & DevOpsRemoteTypeScript★ 2.9k

Exa

Official

Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.

Search & Web ScrapingRemoteTypeScript★ 2.9k

Perplexity

Official

Answers, not links — delegate questions to Perplexity's search-grounded models and get cited responses back.

Search & Web ScrapingTypeScript★ 1.3k