Bảng xếp hạng repo GitHub theo sao, tốc độ tăng trưởng và mức độ hoạt động.

• vllm-project

  #1vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python91.383 saopush cuối 23 giờ trước
• sgl-project

  #2sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  Python35.728 saopush cuối 24 giờ trước
• NVIDIA

  #3NVIDIA/TensorRT-LLM

  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

  Python14.580 saopush cuối 23 giờ trước
• lightseekorg

  #4lightseekorg/tokenspeed

  TokenSpeed is a speed-of-light LLM inference engine.

  Python2.112 saopush cuối 23 giờ trước
• truespar

  #5truespar/paddock

  Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

  Rust75 saopush cuối 2 ngày trước

#	Repo	Ngôn ngữ	Sao	Xu hướng 30 ngày	Cập nhật lần cuối
1	vllm-project vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs	Python	91.383		push cuối 23 giờ trước
2	sgl-project sgl-project/sglang SGLang is a high-performance serving framework for large language models and multimodal models.	Python	35.728		push cuối 24 giờ trước
3	NVIDIA NVIDIA/TensorRT-LLM TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.	Python	14.580		push cuối 23 giờ trước
4	lightseekorg lightseekorg/tokenspeed TokenSpeed is a speed-of-light LLM inference engine.	Python	2.112		push cuối 23 giờ trước
5	truespar truespar/paddock Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio	Rust	75		push cuối 2 ngày trước

Tất cả · 11.474