Local LLMs & Inference

beta9

by beam-cloud · Go

beta9 is an open-source LLM inference tool from beam-cloud, licensed under AGPL-3.0. With 1.8k stars on GitHub, it was last updated in October 2026. Docs and downloads are linked from beam.cloud.

“Ultrafast serverless GPU inference, sandboxes, and background jobs”

— beam-cloud, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,826
Forks171
LanguageGo
LicenseAGPL-3.0
Last updated
Ownerbeam-cloud
Websitebeam.cloud
Repositorybeam-cloud/beta9

Tags

autoscalercloudruncudadeveloper-productivitydistributed-computingfaasfine-tuningfunctions-as-a-service

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Local LLMs & Inference1.8k stars

Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Local LLMs & Inference1.8k stars

react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's…

Local LLMs & Inference1.8k stars

xllm

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators.…

Local LLMs & Inference1.6k stars

splash

A local inference engine for Apple silicon, built around the model.

Local LLMs & Inference1.5k stars