Decorator-based integration testing for LLM prompts
Decorator-based integration testing for LLM prompts
Decorator-based integration testing for LLM prompts. Wrap a test function with @prompt_run, and it sends your prompt to a real model, then hands you the response to assert on — with an LLM judge for the assertions that plain string checks can't express.
Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.
Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.
| Tool | What it does |
|---|---|
| ask_all | many independent checks where cost matters and slight cross-contamination between questions is acceptable. |
| ask_parallel | questions that must be fully isolated, without the latency of sequential ask calls. |
| ask | a single question, or when you need to branch on the result before asking the next. |
{
"mcpServers": {
"prompt-tester": {
"command": "uvx",
"args": ["prompt-tester"],
"env": {
"ANTHROPIC_API_KEY": "your-value",
"GOOGLE_API_KEY": "your-value"
}
}
}
}Add to claude_desktop_config.json, then restart Claude Desktop.
| Variable | Description | Required |
|---|---|---|
| ANTHROPIC_API_KEY | Credential the server authenticates with. | Yes |
| GOOGLE_API_KEY | Credential the server authenticates with. | Yes |
The original Chromium automation reference server — simple, screenshot-driven browser control.
Build a programmable telecommunications stack for connecting telephony services with the Internet via a cloud-based utility.
MCP server for dTelecom real-time speech-to-text with x402 micropayments
A Model Context Protocol (MCP) server that provides access to the Whoop API. It allows language models to query cycles, recovery, strain, and workout
MCP server providing code quality checks (pylint and pytest) with smart LLM-friendly prompts for analysis and fixes. Enables Claude and other AI
Python MCP client + server example