Home › Cloud & Monitoring › llmprobe
llmprobe
Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang, Ollama). CLI + MCP server with Prometheus and OpenTelemetry export.
Topics: Monitoring
Connect
See the repository for installation instructions: https://github.com/Jwrede/llmprobe
Related servers
Netdata
Real-time infrastructure monitoring with metrics, logs, alerts, and ML-based anomaly detection.
Firecrawl MCP Server
MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search.
mcp-grafana
An MCP server giving access to Grafana dashboards, data and more.
sentry-mcp
MCP server for Sentry - error monitoring, issue tracking, and debugging for AI assistants
homebutler
Tells an agent what changed on a server since it last looked - status, Docker, backups, Proxmox.
zabbix-mcp-server
Zabbix integration for hosts, items, triggers, templates, problems, data and more.
Listed in punkpeye/awesome-mcp-servers (MIT)