npm
mcp-evals
观察池 · 暂无正式排名
该项目当前未满足“两个有效维度 + 两种数据源”的主榜门槛。
— 未排名
可观测采用度当前有效 · 2026-09-12 33
动量缺失 —
关注度缺失 —
信号可信度 依据当前有数据的独立评分维度数量计算。
有限1/3 · 1 种数据源
项目介绍
A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring, with built-in observability support. This helps ensure your MCP server's tools are working correctly, performing well, and are fully observable with integrated monitoring and metrics.
You can create evaluation configurations in either TypeScript or YAML format.
Create a file (e.g., evals.ts) that exports your evaluation configuration:
For simpler configuration, you can use YAML format (e.g., evals.yaml):
You can run the evaluations using the CLI with either TypeScript or YAML files:
Each evaluation returns an object with the following structure:
If you're using…