by PAIR-code · Agent Tool · ★ 521
LLM Comparator LLM Comparator is an interactive visualization tool with a python library, for analyzing side-by-side LLM evaluation results. It is designed to help people qualitatively analyze how responses from two models differ at example- and slice-levels. Users can interactively discover insights like "Model A's responses are better than B's on email rewriting tasks because Model A tends to generate bulleted lists more often." Using LLM Comparator You can play with LLM Comparator at https://pair-code.github.io/llm-comparator/.
| Stars | 521 |
| Forks | 50 |
| Language | JavaScript |
| Category | Agent Tool |
| License | Apache-2.0 |
| Quality Score | 62.8832906712694/100 |
| Open Issues | 4 |
| Last Updated | 2025-02-11 |
| Created | 2024-05-07 |
| Platforms | node |
| Est. Tokens | ~706k |
These tools work well together with llm-comparator for enhanced workflows:
Explore other popular agent tool tools:
llm-comparator is LLM Comparator is an interactive data visualization tool for evaluating and analyzing LLM responses side-by-side, developed by the PAIR team.. It is categorized as a Agent Tool with 521 GitHub stars.
llm-comparator is primarily written in JavaScript.
You can find installation instructions and usage details in the llm-comparator GitHub repository at github.com/PAIR-code/llm-comparator. The project has 521 stars and 50 forks, indicating an active community.
llm-comparator is released under the Apache-2.0 license, making it free to use and modify according to the license terms.