GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
vllm-project
A high-throughput and memory-efficient inference and serving engine for LLMs
Python91,383 starslast pushed 23 hours agohiyouga
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Python74,682 starslast pushed 2 days agosgl-project
SGLang is a high-performance serving framework for large language models and multimodal models.
Python35,728 starslast pushed 23 hours agomodelscope
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).
Python15,567 starslast pushed 2 days agoNVIDIA
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Python14,580 starslast pushed 23 hours agoFlashML-org
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Python12,310 starslast pushed 24 hours agoFareedKhan-dev
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
C7,382 starslast pushed 2 weeks agoflashinfer-ai
FlashInfer: Kernel Library for LLM Serving
Cuda6,363 starslast pushed 23 hours ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | vllm-project A high-throughput and memory-efficient inference and serving engine for LLMs | Python | 91,383 | last pushed 23 hours ago | |
| 2 | hiyouga Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) | Python | 74,682 | last pushed 2 days ago | |
| 3 | sgl-project SGLang is a high-performance serving framework for large language models and multimodal models. | Python | 35,728 | last pushed 23 hours ago | |
| 4 | modelscope Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025). | Python | 15,567 | last pushed 2 days ago | |
| 5 | NVIDIA TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. | Python | 14,580 | last pushed 23 hours ago | |
| 6 | FlashML-org FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently. | Python | 12,310 | last pushed 24 hours ago | |
| 7 | FareedKhan-dev A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. | C | 7,382 | last pushed 2 weeks ago | |
| 8 | flashinfer-ai FlashInfer: Kernel Library for LLM Serving | Cuda | 6,363 | last pushed 23 hours ago |
All · 11,474