by alez007 · Agent Tool · ★ 36
Modelship Self-hosted, OpenAI-compatible inference for the agentic era. Modelship runs your whole AI stack — reasoning LLMs with universal tool calling and the Responses API, plus embeddings, speech-to-text, text-to-speech, and image generation — as many models sharing your GPUs (or CPU) behind a single gateway. Built on Ray Serve with pluggable inference backends: vLLM for high-throughput GPU or CPU inference, llama.cpp for high-efficiency GGUF models on CPU or GPU, Diffusers for image generation, and a plugin system for custom backends.
| Stars | 36 |
| Forks | 4 |
| Language | Python |
| Category | Agent Tool |
| License | Apache-2.0 |
| Quality Score | 67.533031157677/100 |
| Last Updated | 2026-07-07 |
| Created | 2025-08-05 |
| Platforms | python |
| Est. Tokens | ~16k |
These tools work well together with modelship for enhanced workflows:
Explore other popular agent tool tools:
modelship is Self-hosted, OpenAI-compatible inference for the agentic era: reasoning LLMs, universal tool calling, and the Responses API alongside embeddings, speech, and image models — many models sharing your GP. It is categorized as a Agent Tool with 36 GitHub stars.
modelship is primarily written in Python. It covers topics such as agentic, diffusers, embeddings.
You can find installation instructions and usage details in the modelship GitHub repository at github.com/alez007/modelship. The project has 36 stars and 4 forks, indicating an active community.
modelship is released under the Apache-2.0 license, making it free to use and modify according to the license terms.