Dataset · Hugging Face

karpathy/fineweb-edu-100B-gpt2-token-shards

Name: fineweb-edu-100B-gpt2-token-shards
Creator: karpathy
License: odc-by
Keywords: license:odc-by, region:us

FineWeb Edu 100B dataset tokenized with GPT-2 tokenizer using the code in llm.c repo.

View on Hugging FaceReport an issue

Author / organization	karpathy
License (as declared)	odc-by
Downloads	4.4K (as reported by Hugging Face)
Likes	9
Created	1 July 2024
Last updated at source	1 July 2024

Embed this entry

<iframe src="https://silytics.si/embed/item/4dafdc35-fb3c-487e-a0db-ceedb56d2654" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

4,354 now (-63 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from karpathy

karpathy/climbmix-400b-shuffleDataset
karpathy/fineweb-edu-100b-shuffleDataset
karpathy/tiny_shakespeareDataset
karpathy/llmc-starter-packDataset
karpathy/tinystories-gpt4-cleanDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.