by hkust-nlp · Agent Tool · ★ 408
The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution Introduction Toolathlon is a benchmark to assess language agents' general tool use in realistic environments. It features 600+ diverse tools based on real-world software environments. Each task requires long-horizon tool calls to complete. Below we show a demo task where the agent needs to automatically check assignments in the email box, and grade them on Canvas. News [2025.12.12] 📣 We have setup a new doc
| Stars | 408 |
| Forks | 45 |
| Language | Python |
| Category | Agent Tool |
| Quality Score | 69.2208527991315/100 |
| Open Issues | 9 |
| Last Updated | 2026-07-02 |
| Created | 2025-10-24 |
| Platforms | python |
| Est. Tokens | ~17k |
Explore other popular agent tool tools:
Toolathlon is [ICLR 2026] The Tool Decathlon: Benchmarking Language Agents for Diverse, Realistic, and Long-Horizon Task Execution. It is categorized as a Agent Tool with 408 GitHub stars.
Toolathlon is primarily written in Python.
You can find installation instructions and usage details in the Toolathlon GitHub repository at github.com/hkust-nlp/Toolathlon. The project has 408 stars and 45 forks, indicating an active community.