by Maximilian-Winter · Agent Tool · ★ 620
llama-cpp-agent Not Longer Maintained. Use instead ToolAgents or other Python agentic frameworks. [] Introduction The llama-cpp-agent framework is a tool designed to simplify interactions with Large Language Models (LLMs). It provides an interface for chatting with LLMs, executing function calls, generating structured output, performing retrieval augmented generation, and processing text using agentic chains with tools. The framework uses guided sampling to constrain the model output to the user defined structures.
| Stars | 620 |
| Forks | 69 |
| Language | Python |
| Category | Agent Tool |
| Quality Score | 71.6139043472405/100 |
| Open Issues | 24 |
| Last Updated | 2026-03-09 |
| Created | 2023-12-29 |
| Platforms | python |
| Est. Tokens | ~383k |
These tools work well together with llama-cpp-agent for enhanced workflows:
Explore other popular agent tool tools:
llama-cpp-agent is The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured ou. It is categorized as a Agent Tool with 620 GitHub stars.
llama-cpp-agent is primarily written in Python. It covers topics such as agents, function-calling, llamacpp.
You can find installation instructions and usage details in the llama-cpp-agent GitHub repository at github.com/Maximilian-Winter/llama-cpp-agent. The project has 620 stars and 69 forks, indicating an active community.