GitHub repo leaderboard by stars, growth rate and activity.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
Official inference library for Mistral models
High-speed Large Language Model Serving for Local Deployment
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. | Python | 43,770 | last pushed 4 hours ago | |
| 2 | Find secrets with Gitleaks 🔑 | Go | 29,223 | last pushed 2 days ago | |
| 3 | 本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地) | HTML | 25,031 | last pushed 2 months ago | |
| 4 | 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale. | Python | 13,655 | last pushed 2 days ago | |
| 5 | Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud. | Python | 12,528 | last pushed 3 days ago | |
| 6 | OpenVINO™ is an open source toolkit for optimizing and deploying AI inference | C++ | 10,830 | last pushed 2 hours ago | |
| 7 | Official inference library for Mistral models | Jupyter Notebook | 10,829 | last pushed 3 months ago | |
| 8 | High-speed Large Language Model Serving for Local Deployment | C++ | 9,788 | last pushed 4 months ago | |
| 9 | The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more! | Python | 8,834 | last pushed 3 days ago | |
| 10 | LMDeploy is a toolkit for compressing, deploying, and serving LLMs. | Python | 8,056 | last pushed 2 days ago |
All · 11,658