gpt_server

About gpt_server

GPT Server [![License][license-shield]][license-url] [![Stars][stars-shield]][stars-url] [![Forks][forks-shield]][forks-url] [![Docker pulls][docker-pulls]][docker-pulls] [![CI Status][ci-shield]][ci-url] [![issue resolution][closed-issues-shield]][closed-issues-url] 本项目依托fastchat的基础能力来提供openai server的能力. 支持Chat、Embedding、ReRanker、text-moderation（文本审核，分类）、ASR、TTS（支持声音克隆）、SD(Stable Diffusion,文生图、文生视频、图片编辑、) 模型的 openai规范 接口服务。 支持HF、vLLM、LMDeploy和SGLang 多种加速推理后端引擎。 多个模型共用openai server的同一个端口进行调用，自动进行模型调度。 如果 GPT Server 对您有帮助，欢迎留下一个 ⭐ Star！ ✨ 功能亮点 ASR(语音

Quick Facts

Compatible Skills

These tools work well together with gpt_server for enhanced workflows:

• voicemode — semantic(0.23)+complementary+rare_topics+same_lang+similar_pop+shared_platform (62%)
• pfi — semantic(0.16)+complementary+rare_topics+same_lang+similar_pop+shared_platform (55%)
• safeclaw — semantic(0.21)+complementary+same_lang+similar_pop+shared_platform (52%)
• ToolRegistry — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)
• agentlys — semantic(0.17)+complementary+same_lang+similar_pop+shared_platform (51%)

More AI Tool Tools

Explore other popular ai tool tools:

• stagehand ⭐ 23.4k
• promptfoo ⭐ 23.0k
• gorilla ⭐ 12.8k
• PocketFlow-Tutorial-Codebase-Knowledge ⭐ 12.4k
• llm ⭐ 12.2k
• llm-engineer-toolkit ⭐ 10.5k
• phoenix ⭐ 10.5k
• code2prompt ⭐ 7.4k
• superagent ⭐ 6.5k
• ai-cookbook ⭐ 4.1k

Popular Python Agent Tools

• hermes-agent ⭐ 211.2k · Codex Skill
• AutoGPT ⭐ 185.4k · Agent Tool
• skills ⭐ 157.3k · Claude Skill
• langflow ⭐ 151.3k · Agent Tool
• open-webui ⭐ 143.9k · MCP Server

Frequently Asked Questions