Prompt MCP Server

Decorator-based integration testing for LLM prompts

Local serverstdioPython

What is the Prompt MCP Server?

Decorator-based integration testing for LLM prompts

The short version

Decorator-based integration testing for LLM prompts. Wrap a test function with @prompt_run, and it sends your prompt to a real model, then hands you the response to assert on — with an LLM judge for the assertions that plain string checks can't express.

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
ask_allmany independent checks where cost matters and slight cross-contamination between questions is acceptable.
ask_parallelquestions that must be fully isolated, without the latency of sequential ask calls.
aska single question, or when you need to branch on the result before asking the next.

How to install the Prompt MCP Server

{
  "mcpServers": {
    "prompt-tester": {
      "command": "uvx",
      "args": ["prompt-tester"],
      "env": {
        "ANTHROPIC_API_KEY": "your-value",
        "GOOGLE_API_KEY": "your-value"
      }
    }
  }
}

Add to claude_desktop_config.json, then restart Claude Desktop.

Configuration

VariableDescriptionRequired
ANTHROPIC_API_KEYCredential the server authenticates with.Yes
GOOGLE_API_KEYCredential the server authenticates with.Yes

Example prompts to try

  • “Use Prompt to ask all.”
  • “Use Prompt to ask parallel.”
  • “Use Prompt to ask.”

Frequently asked questions

Decorator-based integration testing for LLM prompts Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.