smg

Q: What is smg?

smg is Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, ch. It is categorized as a MCP Server with 379 GitHub stars.

Q: What programming language is smg written in?

smg is primarily written in Rust. It covers topics such as anthropic, anthropic-api, chat.

Q: How do I install or use smg?

You can find installation instructions and usage details in the smg GitHub repository at github.com/lightseekorg/smg. The project has 379 stars and 111 forks, indicating an active community.

Q: What license does smg use?

smg is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

by lightseekorg · MCP Server · ★ 379

About smg

Shepherd Model Gateway <img src="https://img.shields.io/badge/PyTorch-Technical%20B

anthropic anthropic-api chat claude gemini inference-gateway lightseek llm mcp openai

Quick Facts

Stars	379
Forks	111
Language	Rust
Category	MCP Server
License	Apache-2.0
Quality Score	65.5385219087921/100
Open Issues	75
Last Updated	2026-07-08
Created	2025-11-22
Platforms	claude-code, gemini, mcp, rust
Est. Tokens	~23k

Compatible Skills

These tools work well together with smg for enhanced workflows:

token_proxy — semantic(0.32)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (72%)
claude-code-mux — semantic(0.16)+complementary+shared_fw(anthropic,openai)+same_lang+similar_pop+shared_platform (67%)
copilot2api-go — semantic(0.22)+complementary+shared_fw(anthropic,openai)+rare_topics+similar_pop+shared_platform (63%)
anthropic-proxy — semantic(0.21)+complementary+shared_fw(anthropic,openai)+similar_pop+shared_platform (58%)
anthropic-max-router — semantic(0.19)+complementary+shared_fw(anthropic,openai)+similar_pop+shared_platform (58%)

More MCP Server Tools

Explore other popular mcp server tools:

ECC ⭐ 226.5k
n8n ⭐ 195.7k
everything-claude-code ⭐ 186.6k
dify ⭐ 148.2k
open-webui ⭐ 143.9k
cc-switch ⭐ 114.8k
gemini-cli ⭐ 105.8k
awesome-mcp-servers ⭐ 90.3k
servers ⭐ 88.1k
lobehub ⭐ 79.6k

View all MCP Server tools →

Popular Rust Agent Tools

cc-switch ⭐ 114.8k · MCP Server
rtk ⭐ 69.5k · Agent Tool
Pake ⭐ 59.6k · Claude Skill
agent-browser ⭐ 38.1k · Agent Tool
zeroclaw ⭐ 32.2k · Codex Skill

Frequently Asked Questions

What is smg?

smg is Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, ch. It is categorized as a MCP Server with 379 GitHub stars.

What programming language is smg written in?

smg is primarily written in Rust. It covers topics such as anthropic, anthropic-api, chat.

How do I install or use smg?

You can find installation instructions and usage details in the smg GitHub repository at github.com/lightseekorg/smg. The project has 379 stars and 111 forks, indicating an active community.

What license does smg use?

smg is released under the Apache-2.0 license, making it free to use and modify according to the license terms.

View on GitHub → Browse MCP Server tools