by CapitalCode2020 · Agent Tool · ★ 121
Infinite Retrieval Introduce Implementation of currently Submitting Paper: "Infinite Retrieval: Attention Enhanced LLMs in Long Context Processing", which can apply any Transformer-based LLMs(Large Language Moidels) to handle unlimited length texts without training. Notably，our method InfiniRretri can enbale the 0.5B(Qwen2.5-0.5B-Instruct), which originally had a maximum context length of 32K, to Haystack(retrieval) up over 1M tokens on Needle-In-a-Haystack(NIH) test, and even theoretically infinite-length.
| Stars | 121 |
| Forks | 10 |
| Category | Agent Tool |
| Quality Score | 57.5093487725507/100 |
| Open Issues | 6 |
| Last Updated | 2025-03-27 |
| Created | 2025-02-17 |
| Est. Tokens | ~173k |
Explore other popular agent tool tools:
InfiniRetri2 is This is InfiniRetri, a tool enhance Transformer-based LLMs(Large Language Model) ablity to hangle Long-Context.. It is categorized as a Agent Tool with 121 GitHub stars.
You can find installation instructions and usage details in the InfiniRetri2 GitHub repository at github.com/CapitalCode2020/InfiniRetri2. The project has 121 stars and 10 forks, indicating an active community.