mlx-llm

by riccardomusmeci · Agent Tool · ★ 459

About mlx-llm

mlx-llm Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX. Go to the entire Youtube Video. How to install 🔨 Models 🧠 Currently, out-of-the-box supported models are: To create a model with pre-trained weights from HuggingFace: You can also load a new version of pre-trained weights for a

llamallmmistralmlxphitransformers

Quick Facts

Stars459
Forks28
LanguagePython
CategoryAgent Tool
Quality Score63.0133906437189/100
Last Updated2025-01-29
Created2023-12-07
Platformspython
Est. Tokens~127k

Compatible Skills

These tools work well together with mlx-llm for enhanced workflows:

  • vllm-mlx — semantic(0.36)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
  • universal-intelligence — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • BambooAI — semantic(0.15)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
  • coderunner — semantic(0.24)+complementary+same_lang+similar_pop+shared_platform (53%)
  • mxcp — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is mlx-llm?

mlx-llm is Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.. It is categorized as a Agent Tool with 459 GitHub stars.

What programming language is mlx-llm written in?

mlx-llm is primarily written in Python. It covers topics such as llama, llm, mistral.

How do I install or use mlx-llm?

You can find installation instructions and usage details in the mlx-llm GitHub repository at github.com/riccardomusmeci/mlx-llm. The project has 459 stars and 28 forks, indicating an active community.

View on GitHub → Browse Agent Tool tools