by microsoft · Agent Tool · ★ 89
:wrench: ToolTalk :speechballoon: :pagefacingup: Paper | :mailbox: Contact Introducing ToolTalk a benchmark for evaluating Tool LLMs in a conversational setting. Details ToolTalk is designed to evaluate tool-augmented LLMs as a chatbot, an increasingly popular paradigm for everyday users to harness the power of LLMs. ToolTalk contains a handcrafted dataset of 28 easy conversations and 50 hard conversations. We annotate these conversations to contain a ground truth usage of 28 unique tools belonging to 7 themed "plugins".
| Stars | 89 |
| Forks | 15 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 65.9751484846764/100 |
| Open Issues | 4 |
| Last Updated | 2024-05-31 |
| Created | 2023-10-10 |
| Platforms | python |
| Est. Tokens | ~19k |
Explore other popular agent tool tools:
ToolTalk is Evaluating tool-augmented LLMs in conversation settings. It is categorized as a Agent Tool with 89 GitHub stars.
ToolTalk is primarily written in Python.
You can find installation instructions and usage details in the ToolTalk GitHub repository at github.com/microsoft/ToolTalk. The project has 89 stars and 15 forks, indicating an active community.
ToolTalk is released under the MIT license, making it free to use and modify according to the license terms.