InferrLM

by loomax-labs · Agent Tool · ★ 99

About InferrLM

InferrLM (Previously Inferra) InferrLM is a mobile application that brings LLMs & SLMs directly to your Android & iOS device and lets your device act as a local server. Cloud-based models like Claude, Gemini and ChatGPT are also supported. File attachments with RAG are also well-supported for local models. If you want to support me and the development of this project, you can donate to me through Ko-fi. Demo Demos of using the Apple Foundation Model and downloading MLX models from HuggingFace and running them on-device. <img src="assets/demo1.gif" alt="Demo 1" h

anthropicdocument-processingedge-aiembeddingsgeminiggufhttp-serverllama-cppllamacpplocal-inference

Quick Facts

Stars99
Forks24
LanguageTypeScript
CategoryAgent Tool
LicenseAGPL-3.0
Quality Score69.636977669813/100
Last Updated2026-06-29
Created2025-02-09
Platformsgemini, node
Est. Tokens~16k

Compatible Skills

These tools work well together with InferrLM for enhanced workflows:

  • InferrLM — semantic(1.00)+rare_topics+same_lang+similar_pop+shared_platform (75%)
  • desktop — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (71%)
  • ClawMem — semantic(0.28)+complementary+rare_topics+same_lang+similar_pop+shared_platform (69%)
  • Turbo-LLM — semantic(0.26)+complementary+rare_topics+same_lang+similar_pop+shared_platform (68%)
  • TurboLLM — semantic(0.26)+complementary+rare_topics+same_lang+similar_pop+shared_platform (68%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular TypeScript Agent Tools

  • openclaw ⭐ 382.2k · Codex Skill
  • n8n ⭐ 195.7k · MCP Server
  • dify ⭐ 148.2k · MCP Server
  • gstack ⭐ 120.5k · Agent Tool
  • gemini-cli ⭐ 105.8k · MCP Server

Frequently Asked Questions

What is InferrLM?

InferrLM is InferrLM - On-device AI for iOS & Android. It is categorized as a Agent Tool with 99 GitHub stars.

What programming language is InferrLM written in?

InferrLM is primarily written in TypeScript. It covers topics such as anthropic, document-processing, edge-ai.

How do I install or use InferrLM?

You can find installation instructions and usage details in the InferrLM GitHub repository at github.com/loomax-labs/InferrLM. The project has 99 stars and 24 forks, indicating an active community.

What license does InferrLM use?

InferrLM is released under the AGPL-3.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools