Md Webcrawl MCP Server

Extracts website content and saves it as markdown files, mapping website structure and links.

Local serverstdioPython★ 4

What is the Md Webcrawl MCP Server?

Extracts website content and saves it as markdown files, mapping website structure and links.

What it actually does

A Python-based MCP (https://modelcontextprotocol.io/introduction) web crawler for extracting and saving website content.

  • Extract website content and save as markdown files
  • Map website structure and links
  • Batch processing of multiple URLs
  • Configurable output directory

Configuration

  • Python 3.7+ - FastMCP (uv pip install fastmcp) - Dependencies listed in requirements.txt

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Configuration

  • Python 3.7+ - FastMCP (uv pip install fastmcp) - Dependencies listed in requirements.txt
VariableDescriptionRequired
OUTPUT_PATHFilesystem location the server is allowed to use.Optional

Example prompts to try

  • “Use Md Webcrawl to OUTPUT PATH.”
  • “Use Md Webcrawl to MAX CONCURRENT REQUESTS.”
  • “Use Md Webcrawl to REQUEST TIMEOUT.”

Frequently asked questions

Md Webcrawl is a Python-based tool designed to extract website content and save it as Markdown files. It also maps website structure and links for easy navigation and archiving.