Built in Python, Rapid-MLX is an open-source LLM inference tool maintained by raullenchai. With 4k stars on GitHub, it was last updated in October 2026. Docs and downloads are linked from rapidmlx.com.
“Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.”
— raullenchai, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 3,996 |
| Forks | 434 |
| Language | Python |
| Last updated | |
| Owner | raullenchai |
| Website | rapidmlx.com |
| Repository | raullenchai/Rapid-MLX |
Tags
anthropic-apiapple-siliconclaude-codecoding-agentscontinuous-batchinginference-serverllm-inferencellm-server
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.