LLM Frameworks & MLOps

gateway

by Portkey-AI · TypeScript

gateway is an open-source LLMOps tool written in TypeScript, released under the MIT license. It has 13k GitHub stars and 1.5k forks, and was last updated in May 2026. Docs and downloads are linked from portkey.ai.

“A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.”

— Portkey-AI, project description on GitHub

Details

CategoryLLM Frameworks & MLOps
GitHub stars13,214
Forks1,459
LanguageTypeScript
LicenseMIT
Last updated
OwnerPortkey-AI
Websiteportkey.ai/features/ai-gateway
RepositoryPortkey-AI/gateway

Tags

ai-gatewaygatewaygenerative-aihacktoberfestlangchainllmllm-gatewayllmops

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All LLM Frameworks & MLOps

phoenix

AI Observability & Evaluation

LLM Frameworks & MLOps12k stars

metaflow

Build, Manage and Deploy AI/ML Systems

LLM Frameworks & MLOps10k stars

Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

LLM Frameworks & MLOps9.3k stars

rig

⚙️🦀 Build modular and scalable LLM Applications in Rust

LLM Frameworks & MLOps8.9k stars

evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered…

LLM Frameworks & MLOps8k stars

openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

LLM Frameworks & MLOps7.5k stars