Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude. The evalview mcp server wraps that behind the Model Context Protocol, so an assistant can use it through 4 defined tools rather than through you.
Record what your agent does today. Get told when it silently changes.
Everything the assistant can do here goes through one of these:
uses — actions/checkout@v4Setup — Record current behaviorCatches — Any drift from baselineNon-determinism — Multi-variant baselines (up to 5 valid paths)You will need one environment variable: OPENAI_API_KEY. The server will not start without them, which is usually why the tools fail to appear on a first run. Keep credentials in your client's env block or a secrets manager rather than in a file you might commit.
Installation goes through your MCP client rather than a global install: point it at evalview on PyPI and it is fetched when the client starts. The copy-paste blocks for Claude Desktop, Claude Code and Cursor are further down this page.
Plenty of payments and commerce servers cover similar ground. The differences that matter in practice are scope of access and how much setup stands between you and a working tool call. Evalview's toolset — uses, Setup, Catches and 1 more — is a fair guide to whether it matches your workflow. It is maintained by hidai25; worth a glance at recent repository activity before you build anything load-bearing on it.
SyncDev reviews every entry in this directory against the project's own documentation before publishing, and revisits them as servers change.
| Tool | What it does |
|---|---|
| uses | actions/checkout@v4 |
| Setup | Record current behavior |
| Catches | Any drift from baseline |
| Non-determinism | Multi-variant baselines (up to 5 valid paths) |
{
"mcpServers": {
"evalview": {
"command": "uvx",
"args": ["evalview"],
"env": {
"OPENAI_API_KEY": "your-value"
}
}
}
}Add to claude_desktop_config.json, then restart Claude Desktop.
| Variable | Description | Required |
|---|---|---|
| OPENAI_API_KEY | Credential the server authenticates with. | Yes |
Payments infrastructure meets AI — customers, invoices, subscriptions and current API docs from Stripe's server.
Build for Shopify with current APIs — the official Dev MCP server for schema-accurate storefront and admin code.
Give your AI assistant a supervised window into your Interactive Brokers account — balances, positions, live quotes and orders.
Invoices, payments and disputes through PayPal's official server — commerce operations by conversation.
Enables querying and listing Azure resources and costs directly from an MCP client.
Empowers LLMs with Bitcoin Lightning Network payment capabilities via the ZBD API.