Skip to content
Weights Not Walls
Menu

OpenLLM

by bentoml

In its repository's words: “Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.”

Repository on GitHubbentoml.com

Facts from GitHub

Licence
Apache-2.0 (Apache License 2.0), permissive, our reading
Activity
Last push 16 Nov 2026: pushed to in the last 90 days
Latest release
not fetched yet
Stars
13k
Main language
Python
On GitHub since
19 Apr 2023
Topics
bentoml, fine-tuning, llama, llama2, llama3-1, llama3-2, llama3-2-vision, llm, llm-inference, llm-ops, llm-serving, llmops, mistral, mlops, model-inference, open-source-llm, openllm, vicuna

Other tools in Serve

All of Serve

Tool data from the GitHub API, fetched 19 Nov 2026, 15:34 UTC. Listing is not endorsement and nobody can pay to be listed. Something wrong here? Write to hello@weightsnotwalls.com.