GitHub repo leaderboard by stars, growth rate and activity.

• vllm-project

  #1vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python91,383 starslast pushed 22 hours ago
• ultralytics

  #2ultralytics/yolov5

  Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.

  Python57,989 starslast pushed 1 week ago
• ggml-org

  #3ggml-org/whisper.cpp

  Port of OpenAI's Whisper model in C/C++

  C++53,565 starslast pushed 3 days ago
• deepspeedai

  #4deepspeedai/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Python43,083 starslast pushed 23 hours ago
• hpcaitech

  #5hpcaitech/ColossalAI

  Making large AI models cheaper, faster and more accessible

  Python41,441 starslast pushed 1 week ago
• sgl-project

  #6sgl-project/sglang

  SGLang is a high-performance serving framework for large language models and multimodal models.

  Python35,728 starslast pushed 23 hours ago
• SYSTRAN

  #7SYSTRAN/faster-whisper

  Faster Whisper transcription with CTranslate2

  Python25,310 starslast pushed 10 months ago
• stas00

  #8stas00/ml-engineering

  Machine Learning Engineering Open Book

  Python18,950 starslast pushed Yesterday
• GeeeekExplorer

  #9GeeeekExplorer/nano-vllm

  Nano vLLM

  Python15,384 starslast pushed 5 months ago
• FlashML-org

  #10FlashML-org/FreeToken

  FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

  Python12,310 starslast pushed 23 hours ago

#	Repo	Language	Stars	30-day trend	Last updated
1	vllm-project vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs	Python	91,383		last pushed 22 hours ago
2	ultralytics ultralytics/yolov5 Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.	Python	57,989		last pushed 1 week ago
3	ggml-org ggml-org/whisper.cpp Port of OpenAI's Whisper model in C/C++	C++	53,565		last pushed 3 days ago
4	deepspeedai deepspeedai/DeepSpeed DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.	Python	43,083		last pushed 23 hours ago
5	hpcaitech hpcaitech/ColossalAI Making large AI models cheaper, faster and more accessible	Python	41,441		last pushed 1 week ago
6	sgl-project sgl-project/sglang SGLang is a high-performance serving framework for large language models and multimodal models.	Python	35,728		last pushed 23 hours ago
7	SYSTRAN SYSTRAN/faster-whisper Faster Whisper transcription with CTranslate2	Python	25,310		last pushed 10 months ago
8	stas00 stas00/ml-engineering Machine Learning Engineering Open Book	Python	18,950		last pushed Yesterday
9	GeeeekExplorer GeeeekExplorer/nano-vllm Nano vLLM	Python	15,384		last pushed 5 months ago
10	FlashML-org FlashML-org/FreeToken FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.	Python	12,310		last pushed 23 hours ago

All · 11,474