LLM Frameworks & MLOps

litellm

by BerriAI · Python

Built in Python, litellm is an open-source LLMOps tool maintained by BerriAI. The repository has collected 62k stars and 12k forks; the latest push was in October 2026. Related topics: ai-gateway, anthropic and azure-openai.

“The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]”

— BerriAI, project description on GitHub

Details

CategoryLLM Frameworks & MLOps
GitHub stars61,509
Forks12,459
LanguagePython
Last updated
OwnerBerriAI
Websitedocs.litellm.ai/docs
RepositoryBerriAI/litellm

Tags

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllm

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All LLM Frameworks & MLOps

Made-With-ML

Learn how to develop, deploy and iterate on production-grade ML applications.

LLM Frameworks & MLOps50k stars

langfuse

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open…

LLM Frameworks & MLOps36k stars

mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes…

LLM Frameworks & MLOps28k stars

opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive…

LLM Frameworks & MLOps23k stars

serve

☁️ Build multimodal AI applications with cloud-native stack

LLM Frameworks & MLOps22k stars

SuperAGI

SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run…

LLM Frameworks & MLOps18k stars