llm-server

by ruska-ai · Agent Tool · ★ 33

About llm-server

🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->

aianthropicbedrockfastapigroqlangchainlarge-language-modelsminioollamaopenai

Quick Facts

Stars33
Forks13
LanguageTypeScript
CategoryAgent Tool
Quality Score38.2/100
Open Issues23
Last Updated2025-06-10
Created2023-11-04
Platformsnode
Est. Tokens~1975k

Compatible Skills

These tools work well together with llm-server for enhanced workflows:

  • brainstorm-mcp — semantic(0.24)+complementary+shared_fw(ollama)+rare_topics+same_lang+similar_pop+shared_platform (66%)
  • llm-use — semantic(0.21)+complementary+shared_fw(anthropic,ollama,openai)+rare_topics+similar_pop (62%)
  • soulshack — semantic(0.29)+complementary+shared_fw(anthropic,ollama,openai)+similar_pop (60%)
  • ollama-mcp — semantic(0.19)+complementary+shared_fw(ollama)+same_lang+similar_pop+shared_platform (60%)
  • abso — semantic(0.29)+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (57%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular TypeScript Agent Tools

  • openclaw ⭐ 374.0k · Codex Skill
  • n8n ⭐ 189.3k · MCP Server
  • dify ⭐ 142.3k · MCP Server
  • gemini-cli ⭐ 104.5k · MCP Server
  • gstack ⭐ 100.8k · Agent Tool

Frequently Asked Questions

What is llm-server?

llm-server is 🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->. It is categorized as a Agent Tool with 33 GitHub stars.

What programming language is llm-server written in?

llm-server is primarily written in TypeScript. It covers topics such as ai, anthropic, bedrock.

How do I install or use llm-server?

You can find installation instructions and usage details in the llm-server GitHub repository at github.com/ruska-ai/llm-server. The project has 33 stars and 13 forks, indicating an active community.

View on GitHub → Browse Agent Tool tools