Sign inGet started
Repository · GitHub

datawhalechina/diy-llm

Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识

Ownerdatawhalechina
Stars1,491
Forks156
Main languageJupyter Notebook
Created24 November 2025
Last updated at source9 October 2026
jupyter notebookdatawhalegpu-programminggrpollmnlprlsfttransformer
Embed this entry
<iframe src="https://silytics.si/embed/item/4e1ba60e-0504-484e-a8b1-b44410e075a4" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from datawhalechina

Silytics shows public metadata from GitHub and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.