GitHub repo leaderboard by stars, growth rate and activity.
21 Lessons, Get Started Building with Generative AI
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠
Learn it. Build it. Ship it for others.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
Machine Learning Engineering Open Book
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
Ongoing research training transformer models at scale
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
| # | Repo | Language | Stars | 30-day trend | Last updated |
|---|---|---|---|---|---|
| 1 | 21 Lessons, Get Started Building with Generative AI | Jupyter Notebook | 119,458 | last pushed Yesterday | |
| 2 | Implement a ChatGPT-like LLM in PyTorch from scratch, step by step | Jupyter Notebook | 104,659 | last pushed 1 week ago | |
| 3 | Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) | Python | 74,682 | last pushed 2 days ago | |
| 4 | 🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠 | Python | 67,405 | last pushed 8 months ago | |
| 5 | Learn it. Build it. Ship it for others. | Python | 53,785 | last pushed 4 days ago | |
| 6 | 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning. | Python | 21,647 | last pushed Yesterday | |
| 7 | Machine Learning Engineering Open Book | Python | 18,950 | last pushed Yesterday | |
| 8 | Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents. | Python | 18,248 | last pushed Yesterday | |
| 9 | Ongoing research training transformer models at scale | Python | 17,825 | — | last pushed 23 hours ago |
| 10 | RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding. | Python | 14,700 | last pushed 1 week ago |
All · 11,474