Conkurrence MCP Server

ConKurrence is a statistically validated consensus measurement toolkit for AI evaluation pipelines. It uses multiple AI models as independent raters

Local serverstdio

What is the Conkurrence MCP Server?

ConKurrence is a statistically validated consensus measurement toolkit for AI evaluation pipelines. It uses multiple AI models as independent raters, measures

What you get

  • Multi-model evaluation — — Run your schema against Bedrock, OpenAI, and Gemini models simultaneously
  • Statistical rigor — — Fleiss' kappa with bootstrap confidence intervals, Kendall's W for validity
  • Self-consistency mode — — No API keys needed; uses the host model via MCP Sampling
  • Schema suggestion — — AI-powered schema design from your data
  • Trend tracking — — Compare runs over time, detect agreement degradation
  • Cost estimation — — Know the cost before running

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
conkurrence_runExecute an evaluation across multiple AI raters
conkurrence_reportGenerate a detailed markdown report
conkurrence_compareSide-by-side comparison of two runs
conkurrence_trendTrack agreement over multiple runs
conkurrence_suggestAI-powered schema suggestion from your data
conkurrence_validate_schemaValidate a schema before running
conkurrence_estimateEstimate cost and token usage

How to install the Conkurrence MCP Server

{
  "mcpServers": {
    "conkurrence": {
      "command": "npx",
      "args": [
        "-y",
        "conkurrence",
        "mcp"
      ]
    }
  }
}

From the project documentation. Replace placeholders and example paths before connecting.

Example prompts to try

  • “Use Conkurrence to conkurrence run.”
  • “Use Conkurrence to conkurrence report.”
  • “Use Conkurrence to conkurrence compare.”

Frequently asked questions

ConKurrence is a statistically validated consensus measurement toolkit for AI evaluation pipelines. It uses multiple AI models as independent raters, measures Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.