PawBench

by agentscope-ai · Codex Skill · ★ 72

About PawBench

🐾 PawBench English · 简体中文 A Model × Harness co-evaluation benchmark for agentic AI. 150 agent tasks · 9 models · 3 harnesses · task slices · diagnostic traces The same model can behave very differently once it is placed inside a real agent runtime. A failure may come from model reasoning, missing tools, weak skill discovery, poor workspace awareness, brittle web access, or a completion check that is too loose. A single final pass rate cannot separate these causes. PawBench is built around one c

agentbenchmarkharnesshermesllmopenclawqwenpaw

Quick Facts

Stars72
Forks5
LanguagePython
CategoryCodex Skill
LicenseApache-2.0
Quality Score66.7888531271658/100
Open Issues2
Last Updated2026-06-25
Created2026-05-15
Platformspython
Est. Tokens~16k

Compatible Skills

These tools work well together with PawBench for enhanced workflows:

  • OpenClawProBench — semantic(0.72)+same_lang+similar_pop+shared_platform (60%)
  • a11y-llm-eval — semantic(0.23)+complementary+same_lang+similar_pop+shared_platform (58%)
  • ollama-benchmark — semantic(0.37)+complementary+same_lang+similar_pop+shared_platform (58%)
  • llm-d-benchmark — semantic(0.37)+complementary+same_lang+similar_pop+shared_platform (58%)

More Codex Skill Tools

Explore other popular codex skill tools:

View all Codex Skill tools →

Popular Python Agent Tools

Frequently Asked Questions

What is PawBench?

PawBench is A benchmark for evaluating LLM × harness performance.. It is categorized as a Codex Skill with 72 GitHub stars.

What programming language is PawBench written in?

PawBench is primarily written in Python. It covers topics such as agent, benchmark, harness.

How do I install or use PawBench?

You can find installation instructions and usage details in the PawBench GitHub repository at github.com/agentscope-ai/PawBench. The project has 72 stars and 5 forks, indicating an active community.

What license does PawBench use?

PawBench is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Codex Skill tools