Local LLMs & Inference

TensorFold

by ashhart · Zig

Built in Zig, TensorFold is an open-source LLM inference tool maintained by ashhart. With 1.4k stars on GitHub, it was last updated in October 2026. Topics include ai, ai-tools and llm.

“LLM Inference Engine for Metal and CUDA.”

— ashhart, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,381
Forks262
LanguageZig
LicenseApache-2.0
Last updated
Ownerashhart
Websitetensorfold.dev
Repositoryashhart/TensorFold

Tags

aiai-toolsllmllm-inferencellm-tools

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

jev

jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with…

Local LLMs & Inference1.4k stars

LeanCopilot

LLMs as Copilots for Theorem Proving in Lean

Local LLMs & Inference1.3k stars

prompt-poet

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

Local LLMs & Inference1.2k stars

tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Local LLMs & Inference1.2k stars

OpenAlpha_Evolve

OpenAlpha_Evolve is an open-source Python framework inspired by the groundbreaking research on autonomous…

Local LLMs & Inference1.1k stars

backburner

Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable

Local LLMs & Inference1k stars