OpenLLM is an open-source LLM inference tool written in Python, released under the Apache-2.0 license. With 13k stars on GitHub, it was last updated in October 2026. Docs and downloads are linked from bentoml.com.
“Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.”
— bentoml, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 12,559 |
| Forks | 966 |
| Language | Python |
| License | Apache-2.0 |
| Last updated | |
| Owner | bentoml |
| Website | bentoml.com |
| Repository | bentoml/OpenLLM |
| Also listed in | LLM Frameworks & MLOps |
Tags
bentomlfine-tuningllamallama2llama3-1llama3-2llama3-2-visionllm
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.