llm-server

by ruska-ai · Agent Tool · ★ 33

About llm-server

🚨 DEPRECATION NOTICE ⚠️ This repository is no longer maintained. As of June 10, 2025, this project has been officially deprecated and archived. It will no longer receive updates, security patches, or support from the maintainers. 👉 Recommended Action: We recommend transitioning to Ensō Orchestra, which serves as the actively maintained and improved successor to this project.

aianthropicbedrockfastapigroqlangchainlarge-language-modelsminioollamaopenai

Quick Facts

Stars33
Forks13
LanguageTypeScript
CategoryAgent Tool
Quality Score70.9227787213943/100
Open Issues23
Last Updated2025-06-10
Created2023-11-04
Platformsnode
Est. Tokens~1975k

Compatible Skills

These tools work well together with llm-server for enhanced workflows:

  • brainstorm-mcp — semantic(0.24)+complementary+shared_fw(ollama)+rare_topics+same_lang+similar_pop+shared_platform (66%)
  • llm-use — semantic(0.21)+complementary+shared_fw(anthropic,ollama,openai)+rare_topics+similar_pop (62%)
  • soulshack — semantic(0.29)+complementary+shared_fw(anthropic,ollama,openai)+similar_pop (60%)
  • ollama-mcp — semantic(0.19)+complementary+shared_fw(ollama)+same_lang+similar_pop+shared_platform (60%)
  • abso — semantic(0.29)+shared_fw(openai)+rare_topics+same_lang+similar_pop+shared_platform (57%)

More Agent Tool Tools

Explore other popular agent tool tools:

View all Agent Tool tools →

Popular TypeScript Agent Tools

  • openclaw ⭐ 382.2k · Codex Skill
  • n8n ⭐ 195.7k · MCP Server
  • dify ⭐ 148.2k · MCP Server
  • gstack ⭐ 120.5k · Agent Tool
  • gemini-cli ⭐ 105.8k · MCP Server

Frequently Asked Questions

What is llm-server?

llm-server is 🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->. It is categorized as a Agent Tool with 33 GitHub stars.

What programming language is llm-server written in?

llm-server is primarily written in TypeScript. It covers topics such as ai, anthropic, bedrock.

How do I install or use llm-server?

You can find installation instructions and usage details in the llm-server GitHub repository at github.com/ruska-ai/llm-server. The project has 33 stars and 13 forks, indicating an active community.

View on GitHub → Browse Agent Tool tools