<strong>Turn websites into clean markdown, JSON, and LLM-ready context.</strong>
Turn websites into clean markdown, JSON, and LLM-ready context.. Exposed over MCP by the webclaw mcp server, that capability becomes something an assistant can invoke while it works, not something you go and do afterwards.
Everything the assistant can do here goes through one of these:
scrape — Extract one URL as markdown, text, JSON, LLM format, or HTMLcrawl — Follow same-origin links and extract discovered pagesmap — Discover URLs without extracting every pagebatch — Scrape multiple URLs in parallelextract — Convert page content into structured datasummarize — Summarize a pagediff — Compare page content snapshotsbrand — Extract colors, fonts, logos, and metadatasearch — Search the web and scrape resultsresearch — Multi-source research workflowHomebrew — The Homebrew tool exposed by this serverCargo — If building from source fails because native build tools are missing, install the platform prerequisites:Being a remote server, there is no local install. You register the endpoint with your client, authorise it once, and the tools appear.
You will need 6 environment variables: WEBCLAW_API_KEY, OLLAMA_HOST, OPENAI_API_KEY, OPENAI_BASE_URL, ANTHROPIC_API_KEY, ANTHROPIC_BASE_URL. The server will not start without them, which is usually why the tools fail to appear on a first run. Keep credentials in your client's env block or a secrets manager rather than in a file you might commit.
Among the AI and media services options, the useful question is rarely "what can it do" but "what does it cost you to run" — permissions, credentials, and how much of your context its toolset consumes. Webclaw's toolset — scrape, crawl, map and 9 more — is a fair guide to whether it matches your workflow. It is maintained by 0xmassi; worth a glance at recent repository activity before you build anything load-bearing on it.
This entry was verified against Webclaw's own documentation before publication; SyncDev keeps the directory reviewed rather than auto-generated.
| Tool | What it does |
|---|---|
| scrape | Extract one URL as markdown, text, JSON, LLM format, or HTML |
| crawl | Follow same-origin links and extract discovered pages |
| map | Discover URLs without extracting every page |
| batch | Scrape multiple URLs in parallel |
| extract | Convert page content into structured data |
| summarize | Summarize a page |
| diff | Compare page content snapshots |
| brand | Extract colors, fonts, logos, and metadata |
| search | Search the web and scrape results |
| research | Multi-source research workflow |
| Homebrew | The Homebrew tool exposed by this server. |
| Cargo | If building from source fails because native build tools are missing, install the platform prerequisites: |
{
"mcpServers": {
"webclaw": {
"command": "npx",
"args": ["-y", "@webclaw/mcp"]
}
}
}Configuration as documented by the project. Restart the client after saving.
| Variable | Description | Required |
|---|---|---|
| WEBCLAW_API_KEY | Credential the server authenticates with. | Yes |
| OLLAMA_HOST | Endpoint or connection string the server talks to. | Optional |
| OPENAI_API_KEY | Credential the server authenticates with. | Yes |
| OPENAI_BASE_URL | Endpoint or connection string the server talks to. | Yes |
| ANTHROPIC_API_KEY | Credential the server authenticates with. | Yes |
| ANTHROPIC_BASE_URL | Endpoint or connection string the server talks to. | Yes |
Build a programmable telecommunications stack for connecting telephony services with the Internet via a cloud-based utility.
Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.
Answers, not links — delegate questions to Perplexity's search-grounded models and get cited responses back.
Give your assistant a voice — text-to-speech, voice cloning and audio tools from the ElevenLabs API.
Give your assistant a real code sandbox — isolated cloud VMs for actually running the code it writes.
The ML hub in your context window — search models, datasets, papers and run Spaces from the official server.