Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.
Evals-mcp-server is an MCP integration. Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.
The published npm package is @cyanheads/evals-mcp-server, version 0.1.6. Its declared MCP transport is stdio.
The package declares EVALS_DATA_DIR: Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.; EVALS_REQUIRE_CONFIRMATION: When 'true', evals_submit_draft requests human confirmation before finalizing.; EVALS_DEFAULT_LICENSE: Default metadata.license applied when a draft omits one.; EVALS_CAPTURE_DIR: Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.; MCP_LOG_LEVEL: Sets the minimum log level for output (e.g., 'debug', 'info', 'warn')..
The published npm package is @cyanheads/evals-mcp-server, version 0.1.6. Its declared MCP transport is streamable-http.
The package declares MCP_TRANSPORT_TYPE: Selects the HTTP transport.; MCP_HTTP_HOST: The hostname for the HTTP server.; MCP_HTTP_PORT: The port to run the HTTP server on.; MCP_HTTP_ENDPOINT_PATH: The endpoint path for the MCP server.; MCP_AUTH_MODE: Authentication mode to use: 'none', 'jwt', or 'oauth'.; EVALS_DATA_DIR: Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.; EVALS_REQUIRE_CONFIRMATION: When 'true', evals_submit_draft requests human confirmation before finalizing.; EVALS_DEFAULT_LICENSE: Default metadata.license applied when a draft omits one.; EVALS_CAPTURE_DIR: Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.; MCP_LOG_LEVEL: Sets the minimum log level for output (e.g., 'debug', 'info', 'warn')..
Check the maintainer’s instructions for account access, authentication and the supported client configuration. Once connected, inspect the tools your client receives and try a small task that matches the server’s stated purpose. The registry description does not include a verified, complete tool list.
View the publisher’s registry entry · Project repository. This profile uses version 0.1.6 from the registry. Registration identifies the publisher namespace; it does not establish that this is a first-party integration for every service it connects.
Browse related developer tools MCP servers for tools that cover the same kind of work.
| Variable | Description | Required |
|---|---|---|
| EVALS_DATA_DIR | Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it. | Check documentation |
| EVALS_REQUIRE_CONFIRMATION | When 'true', evals_submit_draft requests human confirmation before finalizing. | Check documentation |
| EVALS_DEFAULT_LICENSE | Default metadata.license applied when a draft omits one. | Check documentation |
| EVALS_CAPTURE_DIR | Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps. | Check documentation |
| MCP_LOG_LEVEL | Sets the minimum log level for output (e.g., 'debug', 'info', 'warn'). | Check documentation |
Read, search and edit files inside allowed directories with the Model Context Protocol reference Filesystem server.
Retrieve version-aware library documentation and code examples with Context7 MCP, using resolve-library-id and query-docs.
Use Microsoft’s Playwright MCP server to navigate pages, inspect accessibility snapshots, fill forms and capture browser screenshots.
Connect GitHub MCP to repositories, issues and pull requests with GitHub’s hosted service or a locally run server.
Use the Supabase MCP server to inspect database schemas, query project data and retrieve docs through a project-scoped connection.
Search Linear issues and projects, inspect work context and manage updates through Linear’s hosted MCP server with OAuth.