by willkurt · Agent Tool · ★ 207
Token Explorer Token Explorer allows you to interactively explore the token generation process of an LLM, using a "video game" style interface. You can use either arrow keys or vim-style navigation (h/j/k/l) along with WASD keys. Token explore allows you to: Choose a starting prompt, or provide your own text file. Step through generation one token at a time using either: Arrow keys to navigate, pop and append tokens Vim-style keys: h/l to pop/append, j/k to move up/down View the token probabilities and entropies. Add a copy of your current prompt to the list of prompts.
| Stars | 207 |
| Forks | 19 |
| Language | Python |
| Category | Agent Tool |
| License | MIT |
| Quality Score | 68.1146579425714/100 |
| Open Issues | 1 |
| Last Updated | 2025-05-05 |
| Created | 2025-03-13 |
| Platforms | python |
| Est. Tokens | ~191k |
Explore other popular agent tool tools:
token-explorer is A simple tool that let's you explore different possible paths that an LLM might sample.. It is categorized as a Agent Tool with 207 GitHub stars.
token-explorer is primarily written in Python.
You can find installation instructions and usage details in the token-explorer GitHub repository at github.com/willkurt/token-explorer. The project has 207 stars and 19 forks, indicating an active community.
token-explorer is released under the MIT license, making it free to use and modify according to the license terms.