dynamo is an open-source LLM inference tool published on GitHub by ai-dynamo. It has 8.3k GitHub stars and 1.7k forks, and was last updated in October 2026. Docs and downloads are linked from docs.nvidia.com.
“A Datacenter Scale Distributed Inference Serving Framework”
— ai-dynamo, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 8,328 |
| Forks | 1,721 |
| Language | Rust |
| Last updated | |
| Owner | ai-dynamo |
| Website | docs.nvidia.com/dynamo/latest |
| Repository | ai-dynamo/dynamo |
Tags
diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglang
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.