Llm Router MCP Server

llm-router hooks into your coding tool's own lifecycle, reads each prompt before the model does, and drafts an answer on a free or local model first. No API keys needed on a Claude subscription — routing runs through…

Remote serverstreamable-httpPython

What is the Llm Router MCP Server?

Llm Router source profile. From the maintainer documentation: “llm-router hooks into your coding tool's own lifecycle, reads each prompt before the model does, and drafts an answer on a free or local model first. No API keys needed on a Claude subscription — routing runs through MCP tools and local models.”

What it actually does

  • You waste paid tokens on simple questions
  • You burn through Claude, Gemini, or OpenAI quota faster than necessary
  • You stop working when one provider is rate-limited or down

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

How to install the Llm Router MCP Server

{
  "mcpServers": {
    "llm-router": {
      "command": "uvx",
      "args": ["llm-routing"],
      "env": {
        "OPENAI_API_KEY": "your-value",
        "GEMINI_API_KEY": "your-value",
        "OLLAMA_BASE_URL": "your-value",
        "OPENROUTER_API_KEY": "your-value",
        "LLM_ROUTER_POLICY": "your-value",
        "LLM_ROUTER_ENFORCE": "your-value",
        "LLM_ROUTER_PROFILE": "your-value",
        "LLM_ROUTER_BANDIT": "your-value"
      }
    }
  }
}

Add to claude_desktop_config.json, then restart Claude Desktop.

Configuration

VariableDescriptionRequired
OPENAI_API_KEYCredential the server authenticates with.Yes
GEMINI_API_KEYCredential the server authenticates with.Yes
OLLAMA_BASE_URLEndpoint or connection string the server talks to.Yes
OPENROUTER_API_KEYCredential the server authenticates with.Yes
LLM_ROUTER_POLICYConfiguration value read at startup.Optional
LLM_ROUTER_ENFORCEConfiguration value read at startup.Optional
LLM_ROUTER_PROFILEConfiguration value read at startup.Optional
LLM_ROUTER_BANDITConfiguration value read at startup.Optional

Example prompts to try

  • “Use Llm Router to Category.”

Frequently asked questions

<picture> <source media="(prefers-color-scheme: dark)" srcset="assets/readme/hero-dark.svg"> <source media="(prefers-color-scheme: light)" Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.