caliper

by edonadei · Claude Skill · ★ 27

About caliper

Caliper Reliability testing for agent skills. Define what success looks like, run your skill k times, and get a pass@k score you can track and compare. Agent skills are hard to test. A skill that works on your machine, on this prompt, today, might fail tomorrow after a model update or a one-line prompt edit. Caliper makes reliability measurable: define what success looks like, run the skill repeatedly, and get a pass@k score you can track over time.

ai-agentsclaude-codeclicodexevalsevaluationhermeshermes-agenthermes-skillpi

Quick Facts

Stars27
Forks3
LanguagePython
CategoryClaude Skill
LicenseMIT
Quality Score67.449491953858/100
Open Issues7
Last Updated2026-07-05
Created2026-05-13
Platformsclaude-code, cli, codex, python
Est. Tokens~17k

More Claude Skill Tools

Explore other popular claude skill tools:

View all Claude Skill tools →

Popular Python Agent Tools

Frequently Asked Questions

What is caliper?

caliper is Local-first eval harness for Claude Code, Codex, Hermes and Pi skills. It is categorized as a Claude Skill with 27 GitHub stars.

What programming language is caliper written in?

caliper is primarily written in Python. It covers topics such as ai-agents, claude-code, cli.

How do I install or use caliper?

You can find installation instructions and usage details in the caliper GitHub repository at github.com/edonadei/caliper. The project has 27 stars and 3 forks, indicating an active community.

What license does caliper use?

caliper is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Claude Skill tools