rasbt/LLMs-from-scratch · MMO ALL

MMO ALLBuild · Share · Earn

Home Community Projects Following GitHub Insight Opportunity Radar

/

Build · Share · Earn

Pages

About
Rules
Guide

Connect

© 2026 MMO ALL. All rights reserved.

rasbt/LLMs-from-scratch · MMO ALL

← Back to Insight

rasbt

rasbt

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Open on GitHub Project homepage

104,659

Stars

16,033

Forks

2

Open issues

104,659

Watchers

—

License

Jupyter Notebook

Language

Jul 23, 2023

Created

Sep 1, 2026

Last pushed

+0

Star growth · 1 day

Not enough data yet

Star growth · 7 days

Not enough data yet

Star growth · 30 days

Topics

ai artificial-intelligence attention-mechanism deep-learning finetuning from-scratch generative-ai gpt instruction-tuning language-model large-language-models llm machine-learning natural-language-processing pretraining python pytorch tokenizer transformers

Stars over the last 90 days