RetriEVAL MCP Server

RetriEVAL is an MCP integration. LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.

Packages and local setup

The published oci package is ghcr.io/hcarrillo001/retrieval-mcp:1.0.0. Its declared MCP transport is stdio.

The package declares ANTHROPIC_API_KEY: Judge model API key. Not needed if you set RETRIEVAL_JUDGE_BACKEND=ollama to run the judge locally.; RETRIEVAL_JUDGE_BACKEND: Which judge to score with: anthropic (default), openai, or ollama for a fully local judge.; RETRIEVAL_JUDGE_MODEL: Judge model id, e.g. claude-sonnet-4-6 or qwen2.5:14b for Ollama.; RETRIEVAL_BUDGET_USD: Spend cap for judge calls. Unset means no cap..

Before connecting

Check the maintainer’s instructions for account access, authentication and the supported client configuration. Once connected, inspect the tools your client receives and try a small task that matches the server’s stated purpose. The registry description does not include a verified, complete tool list.

Project and source

View the publisher’s registry entry · Project repository · Project website. This profile uses version 1.0.0 from the registry. Registration identifies the publisher namespace; it does not establish that this is a first-party integration for every service it connects.

Browse related other integrations MCP servers for tools that cover the same kind of work.