by rlancemartin · Agent Tool · ★ 1.1k
:brain: :memo: Note See the HuggingFace space for this app: https://huggingface.co/spaces/rlancemartin/auto-evaluator Note See the hosted app: https://autoevaluator.langchain.com/ Note Code for the hosted app is also open source: https://github.com/langchain-ai/auto-evaluator This is a lightweight evaluation tool for question-answering using Langchain to: Ask the user to input a set of documents of interest Apply an LLM () to auto-generate - pairs from these docs Generate a question-answering chain with a specified set of UI-chosen configurations Use the chain to generate a response to each...
| Stars | 1,089 |
| Forks | 93 |
| Language | Python |
| Category | Agent Tool |
| Quality Score | 53.0788166791513/100 |
| Open Issues | 3 |
| Last Updated | 2023-05-10 |
| Created | 2023-04-14 |
| Platforms | python |
| Est. Tokens | ~2967k |
Explore other popular agent tool tools:
auto-evaluator is Evaluation tool for LLM QA chains. It is categorized as a Agent Tool with 1.1k GitHub stars.
auto-evaluator is primarily written in Python.
You can find installation instructions and usage details in the auto-evaluator GitHub repository at github.com/rlancemartin/auto-evaluator. The project has 1.1k stars and 93 forks, indicating an active community.