Run local prompt regression checks from prompt-response logs in AI coding assistants.
Run local prompt regression checks from prompt-response logs in AI coding assistants.
redline is an open-source, local-first eval tool for AI teams. It uses logs you already have: prompts, outputs, support tickets, traces, model responses, and production JSONL exports.
Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.
Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.
| Tool | What it does |
|---|---|
| redline | command not found: run python -m pip install redline-ai, then |
| redline-mcp | let AI coding assistants run checks inside Claude, Codex, |
| uses | gowtham0992/redline@v0.3.0 |
| self | contained HTML for side-by-side inspection, including feature and prompt eval tables |
| suite | Suite baseline path, default redline-suite.json. |
| max_cases | Maximum representative cases selected for a suite. |
| replay | Command used by eval; prompts go to stdin by default. {prompt} is for small legacy argv runners; {prompt_file} passes a temporary rendered-prompt file path. |
| workers | Number of replay cases to run concurrently. |
| owners | Optional pattern-to-owner rules so regressions show the responsible team. |
{
"mcpServers": {
"redline": {
"command": "uvx",
"args": ["redline-ai"]
}
}
}Add to claude_desktop_config.json, then restart Claude Desktop.
Give your coding agent the full DevTools toolbox: traces, network, console, heap snapshots and Lighthouse.
Workers, KV, R2 and D1 by conversation — Cloudflare's official remote servers for building and observability.
A production-grade MCP server that connects any MCP-compatible AI agent to your Langfuse observability data. Query traces, debug errors, inspect
Development MCP server for LangGraph checkpoint and store inspection
Query PanDev Metrics analytics and reporting data
Superlines tracks how your brand appears in AI-powered search engines like ChatGPT, Perplexity, Gemini, and Claude. This MCP server lets you query your Superlines analytics data directly from AI…