LLM Frameworks & MLOps

vllm-ascend

by vllm-project · Python

vllm-ascend is an open-source LLMOps tool from vllm-project, licensed under Apache-2.0. The repository has collected 3k stars and 2.5k forks; the latest push was in October 2026. Topics include inference, llm and llm-serving.

“Community maintained hardware plugin for vLLM on Huawei Ascend”

— vllm-project, project description on GitHub

Details

CategoryLLM Frameworks & MLOps
GitHub stars2,996
Forks2,480
LanguagePython
LicenseApache-2.0
Last updated
Ownervllm-project
Websitedocs.vllm.ai/projects/ascend
Repositoryvllm-project/vllm-ascend

Tags

inferencellmllm-servingllmopsmlopsmodel-servingtransformervllm

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All LLM Frameworks & MLOps

openlit

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve…

LLM Frameworks & MLOps2.9k stars

OpenPipe

Turn expensive prompts into cheap fine-tuned models

LLM Frameworks & MLOps2.8k stars

hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows…

LLM Frameworks & MLOps2.6k stars

burr

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and…

LLM Frameworks & MLOps2.6k stars

cube-studio

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台,算法全链路流程,多租户,算力租赁平台,token中转,拖拉拽任务流pipeline编排,多机多卡分布…

LLM Frameworks & MLOps2.6k stars

bionic-gpt

Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your…

LLM Frameworks & MLOps2.4k stars