by mclenhard · MCP Server · ★ 125
MCP Evals A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring, with built-in observability support. This helps ensure your MCP server's tools are working correctly, performing well, and are fully observable with integrated monitoring and metrics. Installation As a Node.js Package As a GitHub Action Add the following to your workflow file: Usage -- Evals Create Your Evaluation File You can create evaluation configurations in either TypeScript or YAML format.
| Stars | 125 |
| Forks | 12 |
| Language | TypeScript |
| Category | MCP Server |
| License | MIT |
| Quality Score | 78.7880420727528/100 |
| Open Issues | 5 |
| Last Updated | 2025-06-23 |
| Created | 2025-04-23 |
| Platforms | mcp, node |
| Est. Tokens | ~14k |
Explore other popular mcp server tools:
mcp-evals is A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working correctly and perfor. It is categorized as a MCP Server with 125 GitHub stars.
mcp-evals is primarily written in TypeScript. It covers topics such as ai, evals, mcp.
You can find installation instructions and usage details in the mcp-evals GitHub repository at github.com/mclenhard/mcp-evals. The project has 125 stars and 12 forks, indicating an active community.
mcp-evals is released under the MIT license, making it free to use and modify according to the license terms.