Bảng xếp hạng repo GitHub theo sao, tốc độ tăng trưởng và mức độ hoạt động.

• vllm-project

  #1vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python91.451 saopush cuối 2 giờ trước
• bentoml

  #2bentoml/BentoML

  The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

  Python8.834 saopush cuối 4 ngày trước
• vllm-project

  #3vllm-project/vllm-omni

  A framework for efficient model inference with omni-modality models

  Python6.761 saopush cuối 2 giờ trước
• beclab

  #4beclab/Olares

  Open-Source Personal Cloud OS for Always-On Agents

  Go5.265 saopush cuối 11 giờ trước
• FedML-AI

  #5FedML-AI/FedML

  FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

  Python4.065 saopush cuối 11 tháng trước
• vllm-project

  #6vllm-project/vllm-ascend

  Community maintained hardware plugin for vLLM on Ascend

  C++2.794 saopush cuối 3 giờ trước
• kitops-ml

  #7kitops-ml/kitops

  An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

  Go1.412 saopush cuối 3 ngày trước
• truespar

  #8truespar/paddock

  Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

  Rust78 saopush cuối 2 ngày trước

#	Repo	Ngôn ngữ	Sao	Xu hướng 30 ngày	Cập nhật lần cuối
1	vllm-project vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs	Python	91.451		push cuối 2 giờ trước
2	bentoml bentoml/BentoML The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!	Python	8.834		push cuối 4 ngày trước
3	vllm-project vllm-project/vllm-omni A framework for efficient model inference with omni-modality models	Python	6.761		push cuối 2 giờ trước
4	beclab beclab/Olares Open-Source Personal Cloud OS for Always-On Agents	Go	5.265		push cuối 11 giờ trước
5	FedML-AI FedML-AI/FedML FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.	Python	4.065		push cuối 11 tháng trước
6	vllm-project vllm-project/vllm-ascend Community maintained hardware plugin for vLLM on Ascend	C++	2.794		push cuối 3 giờ trước
7	kitops-ml kitops-ml/kitops An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.	Go	1.412		push cuối 3 ngày trước
8	truespar truespar/paddock Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio	Rust	78		push cuối 2 ngày trước

Tất cả · 11.658