Local LLMs & Inference

RuVector

by ruvnet · Rust

RuVector is an open-source LLM inference tool written in Rust, released under the MIT license. It has 4.6k GitHub stars and 613 forks, and was last updated in October 2026. Related topics: ai, ai-ocr and attention-mechanism.

“RuVector provides High Performance, Real-Time decisions and agent memory , Self-Learning Ai, Vector GNN DB built in Rust.”

— ruvnet, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars4,588
Forks613
LanguageRust
LicenseMIT
Last updated
Ownerruvnet
Websitecognitum.one/RuVector
Repositoryruvnet/RuVector

Tags

aiai-ocrattention-mechanismgnngnn-modelgnnsgraphgraph-neural-networks

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

optillm

Optimizing inference proxy for LLMs

Local LLMs & Inference4.3k stars

GenerativeAIExamples

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

Local LLMs & Inference4.2k stars

Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple…

Local LLMs & Inference4k stars

AI-Engineer-Headquarters

A collection of scientific methods, processes, algorithms, and systems to build stories & models.

Local LLMs & Inference3.8k stars

distributed-llama

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More…

Local LLMs & Inference3.1k stars