MCP Server for xCOMET translation quality evaluation
Most developer tooling work still happens through a UI a human drives. Xcomet MCP server moves it into the conversation instead. MCP Server for xCOMET translation quality evaluation.
Translation quality evaluation MCP Server powered by xCOMET (eXplainable COMET).
The server publishes 3 tools. What each one is for:
xcomet_evaluate — Evaluate translation quality for a single source-translation pairxcomet_detect_errors — The xcomet_detect_errors tool exposed by this serverxcomet_batch_evaluate — The xcomet_batch_evaluate tool exposed by this serverConfiguration is passed through the environment: XCOMET_PYTHON_PATH, DEEPL_API_KEY, XCOMET_MODEL, XCOMET_PRELOAD. Treat anything key-shaped as a real credential — scope it to the minimum the server needs, and rotate it if it ever lands in a shared config.
The server ships on npm as xcomet-mcp-server, so your MCP client can launch it on demand — there is no separate build step. Add the server block to your client's configuration, restart it, and the tools register themselves.
This sits in the developer tooling group, where several servers overlap in what they claim to do but differ sharply once you actually set them up. Xcomet's toolset — xcomet_evaluate, xcomet_detect_errors, xcomet_batch_evaluate — is a fair guide to whether it matches your workflow. It is maintained by shuji-bonji; worth a glance at recent repository activity before you build anything load-bearing on it.
We check each listing at SyncDev against the project's documentation before it goes live — if something here drifts out of date, it is a bug worth reporting.
| Tool | What it does |
|---|---|
| xcomet_evaluate | Evaluate translation quality for a single source-translation pair. |
| xcomet_detect_errors | The xcomet_detect_errors tool exposed by this server. |
| xcomet_batch_evaluate | The xcomet_batch_evaluate tool exposed by this server. |
Then configure:
```json
{
"mcpServers": {
"xcomet": {
"command": "xcomet-mcp-server",
"env": {
"XCOMET_PYTHON_PATH": "~/.xcomet-venv/bin/python3"
}
}
}
}Configuration as documented by the project. Restart the client after saving.
| Variable | Description | Required |
|---|---|---|
| XCOMET_PYTHON_PATH | Filesystem location the server is allowed to use. | Optional |
| DEEPL_API_KEY | Credential the server authenticates with. | Yes |
| XCOMET_MODEL | Configuration value read at startup. | Optional |
| XCOMET_PRELOAD | Configuration value read at startup. | Optional |
Kill hallucinated APIs — version-accurate, up-to-date library documentation injected straight into context.
Microsoft's official browser automation server — drive a real browser through the accessibility tree, no screenshots needed.
GitHub's official server — repos, issues, pull requests, Actions and code security, straight from your assistant.
Issue tracking at the speed of conversation — Linear's official hosted server with OAuth and zero install.
Local repository surgery — status, diffs, commits, branches and history for any repo on disk.
Timezone sanity for AI — current time anywhere and correct conversions, without the model doing date math.