by Maximilian-Winter · Agent Tool · ★ 620
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
| Stars | 620 |
| Forks | 69 |
| Language | Python |
| Category | Agent Tool |
| Quality Score | 41.75/100 |
| Open Issues | 24 |
| Last Updated | 2026-03-09 |
| Created | 2023-12-29 |
| Platforms | python |
| Est. Tokens | ~383k |
These tools work well together with llama-cpp-agent for enhanced workflows:
Explore other popular agent tool tools:
llama-cpp-agent is The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured ou. It is categorized as a Agent Tool with 620 GitHub stars.
llama-cpp-agent is primarily written in Python. It covers topics such as agents, function-calling, llamacpp.
You can find installation instructions and usage details in the llama-cpp-agent GitHub repository at github.com/Maximilian-Winter/llama-cpp-agent. The project has 620 stars and 69 forks, indicating an active community.