by ivanfioravanti · AI Tool · ★ 71
LLM Context Benchmarks Benchmark prompt-processing and generation throughput across context sizes (0.5k–128k tokens) for many inference engines: Ollama (API & CLI), MLX, MLX Distributed, MLX-VLM, llama.cpp, LM Studio, Exo, Apple Foundation Models Serve, vMLX, oMLX, Paroquant, and any OpenAI-compatible endpoint. Optimized for Apple Silicon but works anywhere Python runs.
| Stars | 71 |
| Forks | 9 |
| Language | Python |
| Category | AI Tool |
| License | Apache-2.0 |
| Quality Score | 70.7881896020751/100 |
| Open Issues | 4 |
| Last Updated | 2026-07-04 |
| Created | 2025-08-06 |
| Platforms | cli, python |
| Est. Tokens | ~15k |
Explore other popular ai tool tools:
llm_context_benchmarks is 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual benchmark modes (API/CLI), automatic hardware detection (optimized. It is categorized as a AI Tool with 71 GitHub stars.
llm_context_benchmarks is primarily written in Python. It covers topics such as ai, benchmarking, llms.
You can find installation instructions and usage details in the llm_context_benchmarks GitHub repository at github.com/ivanfioravanti/llm_context_benchmarks. The project has 71 stars and 9 forks, indicating an active community.
llm_context_benchmarks is released under the Apache-2.0 license, making it free to use and modify according to the license terms.