BentoML is an open-source LLM inference tool published on GitHub by bentoml. It has 8.9k GitHub stars and 1k forks, and was last updated in October 2026. Topics include ai-inference, deep-learning and generative-ai.
“The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!”
— bentoml, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 8,906 |
| Forks | 1,045 |
| Language | Python |
| License | Apache-2.0 |
| Last updated | |
| Owner | bentoml |
| Website | bentoml.com |
| Repository | bentoml/BentoML |
| Also listed in | LLM Frameworks & MLOps |
Tags
ai-inferencedeep-learninggenerative-aiinference-platformllmllm-inferencellm-servingllmops
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.