GitHub repo leaderboard by stars, growth rate and activity.

• halfrost

  #1halfrost/Halfrost-Field

  ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记

  Go13,234 starslast pushed 1 week ago
• FareedKhan-dev

  #2FareedKhan-dev/kimi-k3-in-c

  A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

  C7,382 starslast pushed 2 weeks ago
• FedML-AI

  #3FedML-AI/FedML

  FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

  Python4,065 starslast pushed 11 months ago
• datawhalechina

  #4datawhalechina/zero-to-sglang

  Official SGLang × Datawhale course on LLM inference (中英双语): understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. 《从零手搓SGLang》：读懂推理，手搓 mini-sglang，吃透 SGLang 源码。

  Python637 starslast pushed 2 days ago
• truespar

  #5truespar/paddock

  Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

  Rust75 starslast pushed 2 days ago

#	Repo	Language	Stars	30-day trend	Last updated
1	halfrost halfrost/Halfrost-Field ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记	Go	13,234		last pushed 1 week ago
2	FareedKhan-dev FareedKhan-dev/kimi-k3-in-c A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.	C	7,382		last pushed 2 weeks ago
3	FedML-AI FedML-AI/FedML FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.	Python	4,065		last pushed 11 months ago
4	datawhalechina datawhalechina/zero-to-sglang Official SGLang × Datawhale course on LLM inference (中英双语): understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. 《从零手搓SGLang》：读懂推理，手搓 mini-sglang，吃透 SGLang 源码。	Python	637		last pushed 2 days ago
5	truespar truespar/paddock Native Rust inference server for open models on NVIDIA GPUs. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio	Rust	75		last pushed 2 days ago

All · 11,474