How do I install the llmprobe mcp server?

This profile does not contain a verified copy-paste launch configuration. Follow the current project documentation to confirm the runtime, entry point, transport and authentication before registering it in your client.

What credentials does it need?

It reads `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, `AZURE_OPENAI_API_KEY`, `AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY`, `GROQ_API_KEY`, `DEEPSEEK_API_KEY`, `TOGETHER_API_KEY` from the environment. Store these in your client's env block or a secrets manager — never commit them to a repository — and grant the narrowest scope that still covers your use case.

SSyncDev

Start a project

Llmprobe MCP Server

llmprobe is a CLI tool for LLM serving reliability. It probes hosted APIs or OpenAI-compatible inference servers, then reports the metrics that

Remote serverstreamable-httpGo

What is the Llmprobe MCP Server?

llmprobe is a CLI tool for LLM serving reliability. It probes hosted APIs or OpenAI-compatible inference servers, then reports the metrics that matter for

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

Tool	What it does
probe_all	Probe all configured endpoints from probes.yml. Returns TTFT, latency, throughput, and health status for every model. Accepts an optional config parameter for a custom config path.
probe_model	Probe a single model without a config file. Requires provider, model, and api_key_env. Supports optional base_url for OpenAI-compatible endpoints and optional label for display.
list_providers	List all providers and models in the config file with their thresholds. Use this to discover available models before probing.
get_config	Return the full parsed configuration including defaults, providers, models, and thresholds.

Configuration

Variable	Description	Required
OPENAI_API_KEY	Credential the server authenticates with.	Yes
ANTHROPIC_API_KEY	Credential the server authenticates with.	Yes
AZURE_OPENAI_API_KEY	Credential the server authenticates with.	Yes
AWS_ACCESS_KEY_ID	Credential the server authenticates with.	Yes
AWS_SECRET_ACCESS_KEY	Credential the server authenticates with.	Yes
GROQ_API_KEY	Credential the server authenticates with.	Yes
DEEPSEEK_API_KEY	Credential the server authenticates with.	Yes
TOGETHER_API_KEY	Credential the server authenticates with.	Yes

Example prompts to try

“Use Llmprobe to probe all.”
“Use Llmprobe to probe model.”
“Use Llmprobe to list providers.”

Frequently asked questions

llmprobe is a CLI tool for LLM serving reliability. It probes hosted APIs or OpenAI-compatible inference servers, then reports the metrics that matter for Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.

Alternatives to the Llmprobe MCP Server

Puppeteer

Official

The original Chromium automation reference server — simple, screenshot-driven browser control.

Browser AutomationTypeScript★ 63.0k

Fonoster

Build a programmable telecommunications stack for connecting telephony services with the Internet via a cloud-based utility.

AI & ML ServicesTypeScript★ 8.1k

Ghostapi

The local internet for AI coding agents.

Developer ToolsTypeScript

Youtube Translate MCP

A [Model Context Protocol (MCP)](https://github.com/anthropics/anthropic-cookbook/tree/main/model_composition_protocol) server for accessing the

AI & ML ServicesPython

GitHub Issue Searcher MCP 🚀

A powerful Model Context Protocol (MCP) Server that combines FAISS (Facebook AI Similarity Search) with OpenAI embeddings to provide semantic search capabilities for GitHub repository issues.…

Developer Tools

GitHub Repository MCP Server

This Model Context Protocol (MCP) server allows AI models to access GitHub repository contents as context. It provides tools to fetch file contents, repository structure, and entire repositories for…