OpenJudge

by agentscope-ai · Agent Tool · ★ 829

About OpenJudge

Holistic Evaluation, Quality Rewards: Driving Application Excellence 🌟 If you find OpenJudge helpful, please give us a Star! 🌟 🌐 Website δΈ­ζ–‡ OpenJudge is an open-source evaluation framework for AI applications (e.g., AI agents or chatbots) designed to evaluate quality and drive continuous application optimization. In practice, application excellence depends on a trustworthy evaluation workflow: Collect test data β†’ Define graders β†’ Run evaluatio

agentagent-skillsai-agentalignmentevaluationgraderllmrewardreward-modelrlhf

Quick Facts

Stars829
Forks67
LanguagePython
CategoryAgent Tool
LicenseApache-2.0
Quality Score60.0328618065128/100
Open Issues13
Last Updated2026-09-11
Created2025-07-08
Platformspython
Est. Tokens~18k

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools β†’

Popular Python Agent Tools

  • hermes-agent ⭐ 254.7k Β· Codex Skill
  • AutoGPT ⭐ 187.6k Β· Agent Tool
  • skills ⭐ 180.2k Β· Claude Skill
  • dify ⭐ 158.8k Β· MCP Server
  • open-webui ⭐ 155.9k Β· MCP Server

Frequently Asked Questions

What is OpenJudge?

OpenJudge is OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards. It is categorized as a Agent Tool with 829 GitHub stars.

What programming language is OpenJudge written in?

OpenJudge is primarily written in Python. It covers topics such as agent, agent-skills, ai-agent.

How do I install or use OpenJudge?

You can find installation instructions and usage details in the OpenJudge GitHub repository at github.com/agentscope-ai/OpenJudge. The project has 829 stars and 67 forks, indicating an active community.

What license does OpenJudge use?

OpenJudge is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools