Llm MCP Server

A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your

Local serverstdio

What is the Llm MCP Server?

Llm MCP lets Claude, Cursor and other MCP clients work with Llm MCP directly. A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your development workflow.

What Llm MCP does

A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your development workflow.

llm-mcp creates an MCP server that provides standardized access to various LLM providers (OpenAI, Google Gemini, and OpenAI-compatible APIs) while supporting advanced features like session management, conversation persistence, and integration with external MCP tools.

Key capabilities

  • 🤖 Multi-Provider Support: Works with OpenAI, Google Gemini, and any OpenAI-compatible API
  • 💬 Session Management: Persist conversations across server restarts
  • 🔧 MCP Tool Integration: Connect to external MCP servers and use their tools within LLM conversations
  • 📝 Comprehensive Logging: JSON-formatted logs for debugging and analysis
  • 🔌 Extensible Architecture: Easy to add new providers and customize behavior
  • 🚀 Built on FastMCP: Leverages the fast and efficient MCP server framework

Practical notes

  • Maintained by parruda.

Recorded tools

  • task — The task tool exposed by this server.
  • reset_session — The reset_session tool exposed by this server.

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
reset_session

How to install the Llm MCP Server

{
  "mcpServers": {
    "llm-mcp": {
      "command": "llm-mcp",
      "args": [
        "mcp-serve",
        "--provider",
        "openai",
        "--model",
        "gpt-4"
      ],
      "env": {
        "OPENAI_API_KEY": "YOUR_OPENAI_API_KEY"
      }
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Configuration

VariableDescriptionRequired
OPENAI_API_KEYDeclared in the maintainer’s client configuration.Check documentation

Example prompts to try

  • “Use Llm MCP to task.”
  • “Use Llm MCP to reset session.”

Frequently asked questions

A Ruby gem that exposes Large Language Models (LLMs) via the Model Context Protocol (MCP), enabling seamless integration of AI capabilities into your development Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.