mlx-omni-server

by madroidmaq · Agent Tool · ★ 714

About mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

function-callinggenaimlxopenaiopenai-apistructured-outputstttoolstts

Quick Facts

Stars714
Forks87
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score42.75/100
Open Issues18
Last Updated2026-05-09
Created2024-11-05
Platformscli, python
Est. Tokens~371k

Compatible Skills

These tools work well together with mlx-omni-server for enhanced workflows:

  • vllm-mlx — semantic(0.33)+complementary+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (78%)
  • MCP-Bridge — semantic(0.20)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (60%)
  • open-responses-server — semantic(0.17)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (59%)
  • coderunner — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (52%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is mlx-omni-server?

mlx-omni-server is MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless. It is categorized as a Agent Tool with 714 GitHub stars.

What programming language is mlx-omni-server written in?

mlx-omni-server is primarily written in Python. It covers topics such as function-calling, genai, mlx.

How do I install or use mlx-omni-server?

You can find installation instructions and usage details in the mlx-omni-server GitHub repository at github.com/madroidmaq/mlx-omni-server. The project has 714 stars and 87 forks, indicating an active community.

What license does mlx-omni-server use?

mlx-omni-server is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools