Local LLMs & Inference

llm-action

by liguodongiot · HTML

llm-action is an open-source LLM inference tool from liguodongiot, licensed under Apache-2.0. With 25k stars on GitHub, it was last updated in October 2026. It is also listed under LLM Frameworks & MLOps.

“本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)”

— liguodongiot, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars25,179
Forks2,959
LanguageHTML
LicenseApache-2.0
Last updated
Ownerliguodongiot
Websitewww.zhihu.com/column/c_1456193767213043713
Repositoryliguodongiot/llm-action
Also listed inLLM Frameworks & MLOps

Tags

llmllm-inferencellm-servingllm-trainingllmops

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Local LLMs & Inference14k stars

OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Local LLMs & Inference13k stars

openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Local LLMs & Inference11k stars

PowerInfer

High-speed Large Language Model Serving for Local Deployment

Local LLMs & Inference9.8k stars

kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no…

Local LLMs & Inference9.1k stars

BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model…

Local LLMs & Inference8.9k stars