RAGScore MCP Server

Generate QA datasets & evaluate RAG systems. Privacy-first, any LLM, local or cloud.

Local serverstdioPython

What is the RAGScore MCP Server?

Generate QA datasets & evaluate RAG systems. Privacy-first, any LLM, local or cloud.

The short version

🔒 Privacy-First • ⚡ Lightning Fast • 🤖 Any LLM • 🏠 Local or Cloud • 🌍 Multilingual

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

How to install the RAGScore MCP Server

{
  "mcpServers": {
    "ragscore": {
      "command": "uvx",
      "args": ["ragscore"],
      "env": {
        "OPENAI_API_KEY": "your-value",
        "ANTHROPIC_API_KEY": "your-value",
        "DASHSCOPE_API_KEY": "your-value",
        "LLM_BASE_URL": "your-value",
        "RAGSCORE_CHUNK_SIZE": "your-value",
        "RAGSCORE_QUESTIONS_PER_CHUNK": "your-value",
        "RAGSCORE_WORK_DIR": "your-value",
        "RAGSCORE_NO_TELEMETRY": "your-value"
      }
    }
  }
}

Add to claude_desktop_config.json, then restart Claude Desktop.

Configuration

VariableDescriptionRequired
OPENAI_API_KEYCredential the server authenticates with.Yes
ANTHROPIC_API_KEYCredential the server authenticates with.Yes
DASHSCOPE_API_KEYCredential the server authenticates with.Yes
LLM_BASE_URLEndpoint or connection string the server talks to.Yes
RAGSCORE_CHUNK_SIZEConfiguration value read at startup.Optional
RAGSCORE_QUESTIONS_PER_CHUNKConfiguration value read at startup.Optional
RAGSCORE_WORK_DIRFilesystem location the server is allowed to use.Optional
RAGSCORE_NO_TELEMETRYConfiguration value read at startup.Optional

Frequently asked questions

Generate QA datasets & evaluate RAG systems. Privacy-first, any LLM, local or cloud. Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.