OpenLLM
by bentomlIn its repository's words: “Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.”
Facts from GitHub
- Licence
- Apache-2.0 (Apache License 2.0), permissive, our reading
- Activity
- Last push 16 Nov 2026: pushed to in the last 90 days
- Latest release
- not fetched yet
- Stars
- 13k
- Main language
- Python
- On GitHub since
- 19 Apr 2023
- Topics
- bentoml, fine-tuning, llama, llama2, llama3-1, llama3-2, llama3-2-vision, llm, llm-inference, llm-ops, llm-serving, llmops, mistral, mlops, model-inference, open-source-llm, openllm, vicuna
Other tools in Serve
- vllm vllm-project, 97k stars
- LocalAI mudler, 50k stars
- sglang sgl-project, 39k stars
- omlx jundot, 24k stars
- TensorRT-LLM NVIDIA, 15k stars
- text-generation-inference huggingface, 11k stars
Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.