vmlx

Q: What is vmlx?

vmlx is vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!. It is categorized as a MCP Server with 745 GitHub stars.

Q: What programming language is vmlx written in?

vmlx is primarily written in Python. It covers topics such as anthropic-api, kvcache-compression, kvcache-optimization.

Q: How do I install or use vmlx?

You can find installation instructions and usage details in the vmlx GitHub repository at github.com/jjang-ai/vmlx. The project has 745 stars and 80 forks, indicating an active community.

Q: What license does vmlx use?

vmlx is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

by jjang-ai · MCP Server · ★ 745

About vmlx

MLX Inference Server for Apple Silicon Self-hosted inference server for LLMs, VLMs, and image generation on Apple Silicon. OpenAI + Anthropic + Ollama compatible HTTP API. Self-hosted; no third-party API keys required. Native MTP artifact detection and family-specific cache policy gates keep speculative/cache settings explicit and model-safe. Looking for a native Swift macOS app or Swift inference engine? See osaurus.ai. <img src="htt

anthropic-api kvcache-compression kvcache-optimization kvcache-reuse llm lmstudio macbook mcp-server mlx mlxllm

Quick Facts

Stars	745
Forks	80
Language	Python
Category	MCP Server
License	Apache-2.0
Quality Score	68.4355676229988/100
Open Issues	43
Last Updated	2026-07-07
Created	2026-02-18
Platforms	mcp, python
Est. Tokens	~21k

Compatible Skills

These tools work well together with vmlx for enhanced workflows:

mlx-omni-server — semantic(0.35)+complementary+shared_fw(openai)+rare_topics+same_lang+shared_platform (60%)
snackcache — semantic(0.17)+complementary+shared_fw(openai)+same_lang+similar_pop+shared_platform (59%)
batchling — semantic(0.18)+complementary+rare_topics+same_lang+similar_pop+shared_platform (56%)

More MCP Server Tools

Explore other popular mcp server tools:

ECC ⭐ 226.5k
n8n ⭐ 195.7k
everything-claude-code ⭐ 186.6k
dify ⭐ 148.2k
open-webui ⭐ 143.9k
cc-switch ⭐ 114.8k
gemini-cli ⭐ 105.8k
awesome-mcp-servers ⭐ 90.3k
servers ⭐ 88.1k
lobehub ⭐ 79.6k

View all MCP Server tools →

Popular Python Agent Tools

hermes-agent ⭐ 211.4k · Codex Skill
AutoGPT ⭐ 185.4k · Agent Tool
skills ⭐ 157.3k · Claude Skill
langflow ⭐ 151.4k · Agent Tool
open-webui ⭐ 143.9k · MCP Server

Frequently Asked Questions

What is vmlx?

vmlx is vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Batching + etc!. It is categorized as a MCP Server with 745 GitHub stars.

What programming language is vmlx written in?

vmlx is primarily written in Python. It covers topics such as anthropic-api, kvcache-compression, kvcache-optimization.

How do I install or use vmlx?

You can find installation instructions and usage details in the vmlx GitHub repository at github.com/jjang-ai/vmlx. The project has 745 stars and 80 forks, indicating an active community.

What license does vmlx use?

vmlx is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse MCP Server tools