Verify a number before an agent asserts it — evals, backtests (Deflated Sharpe), signed receipts.
Numguard MCP server is a hosted integration for AI assistants that speak the Model Context Protocol. Verify a number before an agent asserts it — evals, backtests (Deflated Sharpe), signed receipts.
MCP registry identity — mcp-name: io.github.ipezygj/numguard
Once Numguard is connected, these are the calls the assistant has available:
verify_subset_win — Does "we lead on subset X" survive correcting for how many subsets I tested?verify_model_gap — Is the gap between these two models bigger than the test set can resolve?verify_judge_bias — Is my judge's preference real, or just longer / first / same-family?calibrate_judge — Is the LLM judge I trust actually calibrated against ground truth?audit_leaderboard — Is #1 on this leaderboard statistically real? (rank confidence intervals)verify_agent — This wallet claims a track record — fetch its own public on-chain trades and re-derive the result.audit_addresses — Run that same verdict across an explicit list of addresses. (only the addresses given)verify_vault — Re-derive a vault's APY from its own Deposit/Withdraw events, instead of quoting its page.verify_backing — Re-derive backing = reserves held / token supply, from the chain.verify_guard_trace — Recompute a behavioural-guard verdict over an agent's action trace, and sign it.check_attestation — Look up a numguard credential on-chain. (free, no key, no gas)erc8004_feedback — Build the ERC-8004 giveFeedback call from a verdict, so reputation carries the evidence. (free)Being a remote server, there is no local install. You register the endpoint with your client, authorise it once, and the tools appear.
You will need one environment variable: NUMGUARD_FACILITATOR_URL. The server will not start without them, which is usually why the tools fail to appear on a first run. Keep credentials in your client's env block or a secrets manager rather than in a file you might commit.
Among the AI and media services options, the useful question is rarely "what can it do" but "what does it cost you to run" — permissions, credentials, and how much of your context its toolset consumes. Numguard's toolset — verify_subset_win, verify_model_gap, verify_judge_bias and 9 more — is a fair guide to whether it matches your workflow. It is maintained by ipezygj; worth a glance at recent repository activity before you build anything load-bearing on it.
SyncDev reviews every entry in this directory against the project's own documentation before publishing, and revisits them as servers change.
| Tool | What it does |
|---|---|
| verify_subset_win | *Does "we lead on subset X" survive correcting for how many subsets I tested?* |
| verify_model_gap | *Is the gap between these two models bigger than the test set can resolve?* |
| verify_judge_bias | *Is my judge's preference real, or just longer / first / same-family?* |
| calibrate_judge | *Is the LLM judge I trust actually calibrated against ground truth?* |
| audit_leaderboard | *Is #1 on this leaderboard statistically real?* (rank confidence intervals) |
| verify_agent | *This wallet claims a track record — fetch its own public on-chain trades and re-derive the result.* |
| audit_addresses | *Run that same verdict across an explicit list of addresses.* (only the addresses given) |
| verify_vault | *Re-derive a vault's APY from its own Deposit/Withdraw events, instead of quoting its page.* |
| verify_backing | *Re-derive backing = reserves held / token supply, from the chain.* |
| verify_guard_trace | *Recompute a behavioural-guard verdict over an agent's action trace, and sign it.* |
| check_attestation | *Look up a numguard credential on-chain.* (**free**, no key, no gas) |
| erc8004_feedback | *Build the ERC-8004 giveFeedback call from a verdict, so reputation carries the evidence.* (**free**) |
{
"mcpServers": {
"numguard": {
"command": "uvx",
"args": ["numguard"],
"env": {
"NUMGUARD_FACILITATOR_URL": "your-value"
}
}
}
}Add to claude_desktop_config.json, then restart Claude Desktop.
| Variable | Description | Required |
|---|---|---|
| NUMGUARD_FACILITATOR_URL | Endpoint or connection string the server talks to. | Yes |
Build a programmable telecommunications stack for connecting telephony services with the Internet via a cloud-based utility.
Search built for AI, not humans — semantic web search that returns model-ready content, plus code context.
Answers, not links — delegate questions to Perplexity's search-grounded models and get cited responses back.
Give your assistant a voice — text-to-speech, voice cloning and audio tools from the ElevenLabs API.
Give your assistant a real code sandbox — isolated cloud VMs for actually running the code it writes.
The ML hub in your context window — search models, datasets, papers and run Spaces from the official server.