by sbhjt-gr · Agent Tool · ★ 100
InferrLM (Previously Inferra) InferrLM is a mobile application that brings LLMs & SLMs directly to your Android & iOS device and lets your device act as a local server. Cloud-based models like Claude, Gemini and ChatGPT are also supported. File attachments with RAG are also well-supported for local models. If you want to support me and the development of this project, you can donate to me through Ko-fi. Demo Demos of using the Apple Foundation Model and downloading MLX models from HuggingFace and running them on-device. <img src="assets/demo1.gif" alt="Demo 1" h
| Stars | 100 |
| Forks | 24 |
| Language | TypeScript |
| Category | Agent Tool |
| License | AGPL-3.0 |
| Quality Score | 70.7380747490503/100 |
| Open Issues | 3 |
| Last Updated | 2026-06-24 |
| Created | 2025-02-09 |
| Platforms | gemini, node |
| Est. Tokens | ~16k |
These tools work well together with InferrLM for enhanced workflows:
Explore other popular agent tool tools:
InferrLM is InferrLM - On-device AI for iOS & Android. It is categorized as a Agent Tool with 100 GitHub stars.
InferrLM is primarily written in TypeScript. It covers topics such as anthropic, document-processing, edge-ai.
You can find installation instructions and usage details in the InferrLM GitHub repository at github.com/sbhjt-gr/InferrLM. The project has 100 stars and 24 forks, indicating an active community.
InferrLM is released under the AGPL-3.0 license, making it free to use and modify according to the license terms.