coder_eval

by UiPath · MCP Server · ★ 154

About coder_eval

Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.

agent-evaluationagent-skillsagent-testinganthropicclaudeclaude-codeclaude-code-plugins-marketplaceclaude-code-skillsclaude-skillscodex

Quick Facts

Stars154
Forks5
LanguagePython
CategoryMCP Server
LicenseApache-2.0
Quality Score35.25/100
Open Issues26
Last Updated2026-10-22
Created2026-07-09
Platformsclaude-code, cli, codex, python
Est. Tokens~790k

Compatible Skills

These tools work well together with coder_eval for enhanced workflows:

  • skill-eval-harness — semantic(0.27)+complementary+rare_topics+same_lang+similar_pop+shared_platform (59%)
  • GateMem — semantic(0.22)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • awesome-evals — semantic(0.35)+complementary+rare_topics+similar_pop (56%)
  • evalmonkey — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Python Agent Tools

Frequently Asked Questions

What is coder_eval?

coder_eval is Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.. It is categorized as a MCP Server with 154 GitHub stars.

What programming language is coder_eval written in?

coder_eval is primarily written in Python. It covers topics such as agent-evaluation, agent-skills, agent-testing.

How do I install or use coder_eval?

You can find installation instructions and usage details in the coder_eval GitHub repository at github.com/UiPath/coder_eval. The project has 154 stars and 5 forks, indicating an active community.

What license does coder_eval use?

coder_eval is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse MCP Server tools