by vladfeigin · AI Tool · ★ 20
Framework for evaluating LLM-based agents Intro When developing LLM-based agents, common frequently asked questions are: How to evaluate agents quality? How to monitor them? How to find the best model parameters and prompts? This project offers a comprehensive framework, grounded in real-world production experience, for the evaluation and monitoring of LLM Agents. Project Description This project provides the framework of developing and evaluating LLM-based applications. It includes a conversational bot, the RAG Agent, which allows users to ask questions about the content in their documents.
| Stars | 20 |
| Forks | 1 |
| Language | Python |
| Category | AI Tool |
| Quality Score | 46.1965694096298/100 |
| Open Issues | 1 |
| Last Updated | 2025-03-04 |
| Created | 2024-12-21 |
| Platforms | python |
| Est. Tokens | ~1979k |
Explore other popular ai tool tools:
llm-agents-evaluation is an open-source ai tool by vladfeigin with 20 GitHub stars.
llm-agents-evaluation is primarily written in Python.
You can find installation instructions and usage details in the llm-agents-evaluation GitHub repository at github.com/vladfeigin/llm-agents-evaluation. The project has 20 stars and 1 forks, indicating an active community.