Local LLMs & Inference

scaling-book

by jax-ml · SCSS

Built in SCSS, scaling-book is an open-source LLM inference tool maintained by jax-ml. The repository has collected 1.5k stars and 214 forks; the latest push was in October 2026. Related topics: jax, llm-inference and llms.

“Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs”

— jax-ml, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,487
Forks214
LanguageSCSS
LicenseMIT
Last updated
Ownerjax-ml
Websitejax-ml.github.io/scaling-book
Repositoryjax-ml/scaling-book

Tags

jaxllm-inferencellmsrooflinetpus

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

awesome-ai-web-search

List of software that allows searching the web with the assistance of AI…

Local LLMs & Inference1.5k stars

BrowserAI

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

Local LLMs & Inference1.4k stars

awesome-hacking-lists

A curated collection of top-tier penetration testing tools and productivity utilities across multiple…

Local LLMs & Inference1.4k stars

TensorFold

LLM Inference Engine for Metal and CUDA.

Local LLMs & Inference1.4k stars

jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with…

Local LLMs & Inference1.4k stars

LeanCopilot

LLMs as Copilots for Theorem Proving in Lean

Local LLMs & Inference1.3k stars