GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
metainternal
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Jupyter Notebook18,560 starslast pushed 4 months agohalfrost
✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记
Go13,234 starslast pushed 1 week agoLMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Python11,749 starslast pushed 49 minutes agoxorbitsai
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Python9,564 starslast pushed 1 hour agoai-dynamo
A Datacenter Scale Distributed Inference Serving Framework
Rust8,021 starslast pushed 32 minutes agokvcache-ai
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
C++6,552 starslast pushed 33 minutes agovllm-project
A programmable Mixture-of-Models router for heterogeneous LLM inference
Go5,722 starslast pushed 43 minutes agoOpenBMB
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Python5,688 starslast pushed 2 days agogpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Python5,664 starslast pushed 19 hours agomostlygeek
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
Go5,636 starslast pushed 21 hours ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | metainternal Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services | Jupyter Notebook | 18,560 | last pushed 4 months ago | |
| 2 | halfrost ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记 | Go | 13,234 | last pushed 1 week ago | |
| 3 | LMCache LMCache: Supercharge Your LLM with the Fastest KV Cache Layer | Python | 11,749 | last pushed 49 minutes ago | |
| 4 | xorbitsai Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. | Python | 9,564 | last pushed 1 hour ago | |
| 5 | ai-dynamo A Datacenter Scale Distributed Inference Serving Framework | Rust | 8,021 | last pushed 32 minutes ago | |
| 6 | kvcache-ai Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI. | C++ | 6,552 | — | last pushed 33 minutes ago |
| 7 | vllm-project A programmable Mixture-of-Models router for heterogeneous LLM inference | Go | 5,722 | — | last pushed 43 minutes ago |
| 8 | OpenBMB A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines | Python | 5,688 | last pushed 2 days ago | |
| 9 | gpustack A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. | Python | 5,664 | last pushed 19 hours ago | |
| 10 | mostlygeek Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc | Go | 5,636 | last pushed 21 hours ago |
All · 11,658