smg

by lightseekorg · MCP Server · ★ 274

About smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

anthropicanthropic-apichatclaudegeminiinference-gatewaylightseekllmmcpopenai

Quick Facts

Stars274
Forks80
LanguageRust
CategoryMCP Server
LicenseApache-2.0
Quality Score35.8/100
Open Issues141
Last Updated2026-05-21
Created2025-11-22
Platformsclaude-code, gemini, mcp, rust
Est. Tokens~1951k

Compatible Skills

These tools work well together with smg for enhanced workflows:

  • token_proxy — semantic(0.32)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (72%)
  • claude-code-mux — semantic(0.16)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (67%)
  • copilot2api-go — semantic(0.22)+complementary+shared_fw(anthropic,openai)+rare_topics+similar_pop+shared_platform (63%)
  • anthropic-proxy — semantic(0.21)+complementary+shared_fw(anthropic,openai)+similar_pop+shared_platform (58%)
  • anthropic-max-router — semantic(0.19)+complementary+shared_fw(anthropic,openai)+similar_pop+shared_platform (58%)

More MCP Server Tools

Explore other popular mcp server tools:

View all MCP Server tools →

Popular Rust Agent Tools

Frequently Asked Questions

What is smg?

smg is Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, . It is categorized as a MCP Server with 274 GitHub stars.

What programming language is smg written in?

smg is primarily written in Rust. It covers topics such as anthropic, anthropic-api, chat.

How do I install or use smg?

You can find installation instructions and usage details in the smg GitHub repository at github.com/lightseekorg/smg. The project has 274 stars and 80 forks, indicating an active community.

What license does smg use?

smg is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse MCP Server tools