ai-infra-book is an open-source LLM inference tool written in Python, released under the Apache-2.0 license. The repository has collected 6.7k stars and 519 forks; the latest push was in October 2026. Related topics: accelerator, ai-infra and ai-infrastructure.
“《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验”
— bojieli, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 6,690 |
| Forks | 519 |
| Language | Python |
| License | Apache-2.0 |
| Last updated | |
| Owner | bojieli |
| Website | bojieli.github.io/ai-infra-book |
| Repository | bojieli/ai-infra-book |
Tags
acceleratorai-infraai-infrastructurebookdatacenter-networkdeepseekdistributed-systemsgpu
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.