vllm-cli

by Chen-zexi · AI Tool · ★ 480

About vllm-cli

vLLM CLI A command-line interface tool for serving Large Language Models using vLLM. Provides both interactive and command-line modes with features for configuration profiles, model management, and server monitoring. Interactive terminal interface with GPU status and system overview Tip: You can customize the GPU stats bar in settings Features 🎯 Interactive Mode - Rich terminal interface with menu-driven navigation ⚡ Command-Line Mode - Direct CLI commands for automation and scripting 🤖 Model Management - Automatic discovery of local models with HuggingFace and Ollama support 🔧...

llmllm-inferencellm-toolsvllm

Quick Facts

Stars480
Forks26
LanguagePython
CategoryAI Tool
LicenseMIT
Quality Score77.5351725378302/100
Open Issues3
Last Updated2026-01-25
Created2025-08-14
Platformscli, python
Est. Tokens~431k

Compatible Skills

These tools work well together with vllm-cli for enhanced workflows:

  • LLM-VM — semantic(0.31)+complementary+rare_topics+same_lang+similar_pop+shared_platform (60%)
  • llm_counts — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (58%)
  • lm-proxy — semantic(0.21)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • Noema-Declarative-AI — semantic(0.20)+complementary+rare_topics+same_lang+similar_pop+shared_platform (57%)
  • local-llm-function-calling — semantic(0.17)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)

More AI Tool Tools

Explore other popular ai tool tools:

View all AI Tool tools →

Popular Python Agent Tools

Frequently Asked Questions

What is vllm-cli?

vllm-cli is A command-line interface tool for serving LLM using vLLM.. It is categorized as a AI Tool with 480 GitHub stars.

What programming language is vllm-cli written in?

vllm-cli is primarily written in Python. It covers topics such as llm, llm-inference, llm-tools.

How do I install or use vllm-cli?

You can find installation instructions and usage details in the vllm-cli GitHub repository at github.com/Chen-zexi/vllm-cli. The project has 480 stars and 26 forks, indicating an active community.

What license does vllm-cli use?

vllm-cli is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse AI Tool tools