Crawlab MCP Server

# Crawlab MCP Server This is a Model Context Protocol (MCP) server for Crawlab, allowing AI applications to interact with Crawlab's functionality. ##

Local serverstdioPython

What is the Crawlab MCP server?

If you already use Crawlab, the crawlab mcp server is the piece that lets your assistant work with it directly. # Crawlab MCP Server This is a Model Context Protocol (MCP) server for Crawlab, allowing AI applications to interact with Crawlab's functionality. ## Overview The MCP server provides a standardized way for AI applications to access.

Available tools

The toolset is worth reading before you wire it up, because it tells you what the integration is really for:

  • Prerequisites — The Prerequisites tool exposed by this server
  • Configuration — 1. Copy the .env.example file to .env: cp .env.example .env
  • Resources — The Resources tool exposed by this server
  • Tools — The Tools tool exposed by this server

Credentials and setup notes

Configuration is passed through the environment: SERVER_URL, CRAWLAB_API_BASE_URL, CRAWLAB_API_TOKEN. Treat anything key-shaped as a real credential — scope it to the minimum the server needs, and rotate it if it ever lands in a shared config.

  • Python 3.8+ - Crawlab instance running and accessible - API token from Crawlab

Installation

The server ships on PyPI as git, so your MCP client can launch it on demand — there is no separate build step. Add the server block to your client's configuration, restart it, and the tools register themselves.

Where it fits

This sits in the AI and media services group, where several servers overlap in what they claim to do but differ sharply once you actually set them up. Crawlab's toolset — Prerequisites, Configuration, Resources and 1 more — is a fair guide to whether it matches your workflow. It is maintained by crawlab-team; worth a glance at recent repository activity before you build anything load-bearing on it.

This entry was verified against Crawlab's own documentation before publication; SyncDev keeps the directory reviewed rather than auto-generated.

Worth knowing first

  • It runs with your machine's permissions. That is convenient and also the reason to think about what you point it at before you approve a tool call.
  • Missing credentials fail quietly in some clients — if no tools show up, check the environment block first.
  • Keep per-call confirmation enabled while you learn its behaviour; it is the cheapest safeguard you have.

Available tools

ToolWhat it does
PrerequisitesThe Prerequisites tool exposed by this server.
Configuration1. Copy the .env.example file to .env: cp .env.example .env
ResourcesThe Resources tool exposed by this server.
ToolsThe Tools tool exposed by this server.

How to install the Crawlab MCP server

{
  "mcpServers": {
    "crawlab": {
      "command": "uvx",
      "args": ["git"],
      "env": {
        "SERVER_URL": "your-value",
        "CRAWLAB_API_BASE_URL": "your-value",
        "CRAWLAB_API_TOKEN": "your-value"
      }
    }
  }
}

Add to claude_desktop_config.json, then restart Claude Desktop.

Configuration

  • Python 3.8+ - Crawlab instance running and accessible - API token from Crawlab
VariableDescriptionRequired
SERVER_URLEndpoint or connection string the server talks to.Yes
CRAWLAB_API_BASE_URLEndpoint or connection string the server talks to.Yes
CRAWLAB_API_TOKENCredential the server authenticates with.Yes

Example prompts to try

  • Use Crawlab to Prerequisites.
  • Use Crawlab to Configuration.
  • Use Crawlab to Resources.

Frequently asked questions

It is a standard MCP server that translates AI application tool calls into Crawlab API requests, enabling natural‑language control of Crawlab’s spider, task, and file management features.