vakra

About vakra

🔷 VAKRA: A Benchmark for Evaluating Multi-Hop, Multi-Source Tool-Calling in AI Agents VAKRA (eValuating API and Knowledge Retrieval Agents using multi-hop, multi-source dialogues) is a tool-grounded, executable benchmark designed to evaluate how well AI agents reason end-to-end in enterprise-like settings. Rather than testing isolated skills, VAKRA measures compositional reasoning across APIs and documents, using full execution traces to assess whether agents can reliably complete multi-step workflows, not just individual steps.

Quick Facts

Compatible Skills

These tools work well together with vakra for enhanced workflows:

• ToolRegistry — semantic(0.22)+complementary+same_lang+similar_pop+shared_platform (53%)
• MCPToolBenchPP — semantic(0.22)+complementary+same_lang+similar_pop+shared_platform (53%)
• observee — semantic(0.19)+complementary+same_lang+similar_pop+shared_platform (52%)

More Agent Tool Tools

Explore other popular agent tool tools:

• superpowers ⭐ 249.2k
• AutoGPT ⭐ 185.4k
• ollama ⭐ 175.7k
• skills ⭐ 159.6k
• langflow ⭐ 151.3k
• langchain ⭐ 141.3k
• gstack ⭐ 120.4k
• browser-use ⭐ 103.4k
• autoresearch ⭐ 90.3k
• deer-flow ⭐ 76.4k

Popular Python Agent Tools

• hermes-agent ⭐ 211.2k · Codex Skill
• AutoGPT ⭐ 185.4k · Agent Tool
• skills ⭐ 157.3k · Claude Skill
• langflow ⭐ 151.3k · Agent Tool
• open-webui ⭐ 143.9k · MCP Server

Frequently Asked Questions