Llm MCP Server

A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your

Local serverstdio

What is the Llm MCP MCP server?

Llm mcp mcp server lets Claude, Cursor and other MCP clients work with Llm MCP directly. A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your development workflow.

What Llm MCP does

A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your development workflow.

llm-mcp creates an MCP server that provides standardized access to various LLM providers (OpenAI, Google Gemini, and OpenAI-compatible APIs) while supporting advanced features like session management, conversation persistence, and integration with external MCP tools.

Key capabilities

  • 🤖 Multi-Provider Support: Works with OpenAI, Google Gemini, and any OpenAI-compatible API
  • 💬 Session Management: Persist conversations across server restarts
  • 🔧 MCP Tool Integration: Connect to external MCP servers and use their tools within LLM conversations
  • 📝 Comprehensive Logging: JSON-formatted logs for debugging and analysis
  • 🔌 Extensible Architecture: Easy to add new providers and customize behavior
  • 🚀 Built on FastMCP: Leverages the fast and efficient MCP server framework

Tools it exposes

Once connected, the assistant can call these 2 tools directly:

  • task — The task tool exposed by this server
  • reset_session — The reset_session tool exposed by this server

Installing the llm mcp mcp server

Setup follows the standard MCP pattern: clone or install the server, then register it in your client's configuration file and restart the client. The configuration snippets on this page cover Claude Desktop, Claude Code and Cursor.

Configuration

Before the server will start you need to supply 4 environment variables: GITHUB_TOKEN, OPENAI_API_KEY, GEMINI_API_KEY, GOOGLE_API_KEY. Keep credentials in your client's env block or a secrets manager rather than committing them.

Where it fits

AI-service servers chain other models into your assistant, turning a single chat into a small production pipeline. Llm MCP sits in that group, and the shape of its toolset — task, reset_session — tells you what it is really for. Worth comparing against the other ai services servers in this directory before you commit to one, since several overlap in scope but differ sharply in setup cost and permissions.

Practical notes

  • This server runs locally, so it operates with whatever access your machine and its credentials already have. Scope that deliberately rather than by default.
  • It will not start until its required credentials are present, so set those before wondering why the tools never appear.
  • Maintained by parruda.
  • MCP clients ask for confirmation before each tool call by default. Keep that on while you learn what the llm mcp mcp server actually does with your data.
  • Every entry in this directory is reviewed by hand before it goes live, and details are checked against the project's own documentation.

Available tools

ToolWhat it does
taskThe task tool exposed by this server.
reset_sessionThe reset_session tool exposed by this server.

How to install the Llm MCP MCP server

{
  "mcpServers": {
    "filesystem": {
      "command": "npx",
      "args": ["@modelcontextprotocol/server-filesystem", "/tmp"]
    },
    "github": {
      "command": "mcp-github",
      "env": {
        "GITHUB_TOKEN": "your-github-token"
      }
    },
    "http-api": {
      "url": "https://api.example.com/mcp/sse",
      "transport": "sse",
      "headers": {
        "Authorization": "Bearer your-token"
      }
    }
  }
}

Configuration as documented by the project. Restart the client after saving.

Configuration

VariableDescriptionRequired
GITHUB_TOKENCredential the server authenticates with.Yes
OPENAI_API_KEYCredential the server authenticates with.Yes
GEMINI_API_KEYCredential the server authenticates with.Yes
GOOGLE_API_KEYCredential the server authenticates with.Yes

Example prompts to try

  • Use Llm MCP to task.
  • Use Llm MCP to reset session.

Frequently asked questions

It connects Llm MCP to MCP-compatible AI assistants such as Claude and Cursor, exposing 2 tools (task, reset_session) that the assistant can call on your behalf. Instead of copying data back and forth by hand, the assistant works with Llm MCP directly.