EvalForge Lite MCP Server

Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.

Local serverstdio

What is the EvalForge Lite MCP Server?

EvalForge Lite is an MCP integration. Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.

Packages and local setup

The published pypi package is evalforge-lite, version 1.0.1. Its declared MCP transport is stdio.

The package declares OPENROUTER_API_KEY: Optional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call..

Before connecting

Check the maintainer’s instructions for account access, authentication and the supported client configuration. Once connected, inspect the tools your client receives and try a small task that matches the server’s stated purpose. The registry description does not include a verified, complete tool list.

Project and source

View the publisher’s registry entry · Project repository · Project website. This profile uses version 1.0.1 from the registry. Registration identifies the publisher namespace; it does not establish that this is a first-party integration for every service it connects.

Browse related other integrations MCP servers for tools that cover the same kind of work.

Configuration

VariableDescriptionRequired
OPENROUTER_API_KEYOptional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call.Optional