Ollama MCP Server

Offload cheap work from your AI agent to a local Ollama model, at zero cloud cost.

Local serverstdioPython

What is the Ollama MCP Server?

Offload cheap work from your AI agent to a local Ollama model, at zero cloud cost.

What you get

This isn't a generic "wrap the Ollama API" server. Each tool ships with a baked-in system prompt and a description written for the calling agent, so the agent knows when to hand off and gets a tuned result back without re-stating instructions every call.

  • 💸 Spend less. Routine offloads run locally and bill nothing
  • ⚡ Keep the big model focused. Summaries, extractions, and drafts don't eat its context or your budget
  • 🧠 Tuned, not raw. summarize_local, code_review_local, draft_commit_message_local, and extract_local come with reviewer/summarizer/extractor system prompts already dialed in
  • 🔌 Drop-in. One MCP registration; works with Claude Code, Claude Desktop, Cursor, and any MCP client
  • 🪶 Tiny & auditable. Two dependencies (mcp, httpx), fully typed, unit-tested, no telemetry

Configuration and credentials

  • Ollama running locally (ollama serve) with at least one model pulled, e.g. ollama pull qwen2.5-coder:14b. - Python 3.11+ (or just uvx, which manages it for you).

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
ask_localA single prompt with an optional system instruction
chat_localA conversation with explicit message history
summarize_localSummaries of supplied text, optionally focused on a topic
code_review_localInitial review of supplied code or a diff
draft_commit_message_localA commit message from a supplied diff
extract_localExtracting items such as URLs, names, or error codes
list_modelsDiscovering installed Ollama models
server_infoInspecting effective server configuration

How to install the Ollama MCP Server

{
  "mcpServers": {
    "ollama-handoff": {
      "command": "uvx",
      "args": [
        "ollama-handoff@0.1.3"
      ],
      "env": {
        "OLLAMA_DEFAULT_MODEL": "llama3.1:8b"
      }
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Configuration

  • Ollama running locally (ollama serve) with at least one model pulled, e.g. ollama pull qwen2.5-coder:14b. - Python 3.11+ (or just uvx, which manages it for you).
VariableDescriptionRequired
OLLAMA_DEFAULT_MODELDeclared in the maintainer’s client configuration.Check documentation

Example prompts to try

  • “Use Ollama to ask local.”
  • “Use Ollama to chat local.”
  • “Use Ollama to summarize local.”

Frequently asked questions

Offload cheap work from your AI agent to a local Ollama model, at zero cloud cost. Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.