GitHub Open Source Insight
Computed at Sep 11, 2026GitHub repo leaderboard by stars, growth rate and activity.
metainternal
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Jupyter Notebook18,560 starslast pushed 4 months agohalfrost
✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记
Go13,234 starslast pushed 1 week agoLMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Python11,733 starslast pushed 23 hours agoxorbitsai
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Python9,562 starslast pushed 2 days agoai-dynamo
A Datacenter Scale Distributed Inference Serving Framework
Rust8,008 starslast pushed 22 hours agoOpenBMB
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Python5,686 starslast pushed 2 days agogpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Python5,647 starslast pushed 23 hours agomostlygeek
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc
Go5,629 starslast pushed 24 hours agolemony-ai
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
Python3,955 starslast pushed 2 days agoPaddlePaddle
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
Python3,713 starslast pushed 2 weeks ago
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | metainternal Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services | Jupyter Notebook | 18,560 | last pushed 4 months ago | |
| 2 | halfrost ✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记 | Go | 13,234 | last pushed 1 week ago | |
| 3 | LMCache LMCache: Supercharge Your LLM with the Fastest KV Cache Layer | Python | 11,733 | last pushed 23 hours ago | |
| 4 | xorbitsai Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. | Python | 9,562 | last pushed 2 days ago | |
| 5 | ai-dynamo A Datacenter Scale Distributed Inference Serving Framework | Rust | 8,008 | last pushed 22 hours ago | |
| 6 | OpenBMB A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines | Python | 5,686 | last pushed 2 days ago | |
| 7 | gpustack A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. | Python | 5,647 | last pushed 23 hours ago | |
| 8 | mostlygeek Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc | Go | 5,629 | last pushed 24 hours ago | |
| 9 | lemony-ai Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop. | Python | 3,955 | last pushed 2 days ago | |
| 10 | PaddlePaddle High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle | Python | 3,713 | last pushed 2 weeks ago |
All · 11,474