SSyncDev

MCP Go Colly MCP Server

1. Clone the repository: ```bash git clone https://github.com/yourusername/mcp-go-colly.git cd mcp-go-colly ```

Local serverstdioGo

What is the MCP Go Colly MCP Server?

MCP Go Colly lets Claude, Cursor and other MCP clients work with MCP Go Colly directly. 1. Clone the repository: bash git clone https://github.com/yourusername/mcp-go-colly.git cd mcp-go-colly .

What MCP Go Colly does

  1. Clone the repository: bash git clone https://github.com/yourusername/mcp-go-colly.git cd mcp-go-colly

MCP Go Colly is a sophisticated web crawling framework that integrates the Model Context Protocol (MCP) with the powerful Colly web scraping library. This project aims to provide a flexible and extensible solution for extracting web content for large language model (LLM) applications.

Key capabilities

  • Concurrent web crawling with configurable depth and domain restrictions
  • MCP server integration for tool-based crawling
  • Graceful shutdown handling
  • Robust error handling and result formatting
  • Support for both single URL and batch URL crawling

Requirements

  • Go 1.21 or later - Make (for using Makefile commands)

Practical notes

  • Maintained by bneil, written in Go.

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

How to install the MCP Go Colly MCP Server

{
  "mcpServers": {
    "web-scraper": {
      "command": "<add path here>/mcp-go-colly/bin/mcp-go-colly"
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Configuration

  • Go 1.21 or later - Make (for using Makefile commands)

Example prompts to try

  • “Use MCP Go Colly to Prerequisites.”
  • “Use MCP Go Colly to Installation.”
  • “Use MCP Go Colly to Building.”

Frequently asked questions

1. Clone the repository: ```bash git clone https://github.com/yourusername/mcp-go-colly.git cd mcp-go-colly ``` Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.

Alternatives to the MCP Go Colly MCP Server

Filesystem

Official

Read, search and edit files inside allowed directories with the Model Context Protocol reference Filesystem server.

File Systems & StorageTypeScript★ 63.0k

Context7

Official

Retrieve version-aware library documentation and code examples with Context7 MCP, using resolve-library-id and query-docs.

Documentation & API ReferencesRemoteTypeScript★ 32.0k

Wigolo

Local-first web intelligence MCP server for AI coding agents

Developer ToolsRemotePython

Squish

Give AI random access to video: timestamped contact sheets + zoom into any start/end range.

Developer ToolsRemote

Paths To Tree MCP

This repository contains a **minimal [Model&nbsp;Context&nbsp;Protocol](https://modelcontextprotocol.io) server** that exposes one tool –

File Systems & StoragePython

MISP

An MCP server for the open source MISP project

Developer ToolsPython