Local LLMs & Inference

llama2-webui

by liltom-eth · Jupyter Notebook

Built in Jupyter Notebook, llama2-webui is an open-source LLM inference tool maintained by liltom-eth. The repository has collected 1.9k stars and 197 forks; the latest push was in March 2024. Topics include llama-2, llama2 and llm.

“Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.”

— liltom-eth, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars1,934
Forks197
LanguageJupyter Notebook
LicenseMIT
Last updated
Ownerliltom-eth
Repositoryliltom-eth/llama2-webui

Tags

llama-2llama2llmllm-inference

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

InferenceX

Open Source AI Accelerator Research Platform Standard / 开源推理研究平台

Local LLMs & Inference1.9k stars

aigrantsindia

The non profit fostering AI in India through credits, grants, resources

Local LLMs & Inference1.8k stars

beta9

Ultrafast serverless GPU inference, sandboxes, and background jobs

Local LLMs & Inference1.8k stars

kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Local LLMs & Inference1.8k stars

Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your…

Local LLMs & Inference1.8k stars

react-native-executorch

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's…

Local LLMs & Inference1.8k stars