Repository · GitHub

rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Owner	rasbt
Stars	106,530
Forks	16,391
Main language	Jupyter Notebook
Created	23 July 2023
Last updated at source	2 October 2026

jupyter notebookaiartificial-intelligenceattention-mechanismdeep-learningfinetuningfrom-scratchgenerative-aigptinstruction-tuninglanguage-modellarge-language-modelsllmmachine-learningnatural-language-processingpretrainingpythonpytorchtokenizertransformers

More from rasbt

python-machine-learning-bookRepository
python-machine-learning-book-2nd-editionRepository
machine-learning-bookRepository
reasoning-from-scratchRepository
mlxtendRepository
python-machine-learning-book-3rd-editionRepository

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.