mlx-omni-server

by madroidmaq · Agent Tool · ★ 714

About mlx-omni-server

MLX Omni Server Local AI inference server optimized for Apple Silicon MLX Omni Server provides dual API compatibility with both OpenAI and Anthropic APIs, enabling seamless local inference on Apple Silicon using the MLX framework. Installation • Quick Start • Documentation • Contributing ✨ Features 🚀 Apple Silicon Optimized - Built on MLX framework for M1/M2/M3/M4 chips 🔌 Dual API Support - Compatible with both OpenAI and Anthropic APIs 🎯 Complete AI Suite - Chat, audio processing, image generation, embeddings ⚡ High Performance - Local inference with hardware acceleration 🔐 Privacy-First...

function-callinggenaimlxopenaiopenai-apistructured-outputstttoolstts

Quick Facts

Stars714
Forks87
LanguagePython
CategoryAgent Tool
LicenseMIT
Quality Score68.1450274928993/100
Open Issues18
Last Updated2026-05-09
Created2024-11-05
Platformscli, python
Est. Tokens~371k

Compatible Skills

These tools work well together with mlx-omni-server for enhanced workflows:

  • vllm-mlx — semantic(0.33)+complementary+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (78%)
  • MCP-Bridge — semantic(0.20)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (60%)
  • open-responses-server — semantic(0.17)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (59%)
  • coderunner — semantic(0.20)+complementary+same_lang+similar_pop+shared_platform (52%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is mlx-omni-server?

mlx-omni-server is MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless. It is categorized as a Agent Tool with 714 GitHub stars.

What programming language is mlx-omni-server written in?

mlx-omni-server is primarily written in Python. It covers topics such as function-calling, genai, mlx.

How do I install or use mlx-omni-server?

You can find installation instructions and usage details in the mlx-omni-server GitHub repository at github.com/madroidmaq/mlx-omni-server. The project has 714 stars and 87 forks, indicating an active community.

What license does mlx-omni-server use?

mlx-omni-server is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse Agent Tool tools