Sign inGet started
Dataset · Hugging Face

Liangzhi-Li/fineweb-124m-pretraining

FineWeb 124M pretraining material Training text, token files and checkpoints of small (124-million-parameter) Llama-architecture language models trained on FineWeb. Folder Contents corpora/fineweb/ Shards of FineWeb as released (fields text, id, url, dump, date, language_score), named by Common Crawl dump: dumps of 2019–2021 and of 2024–2025. corpora/cosmopedia/ Shards of Cosmopedia. tokens/gpt2/ fineweb_2019-2021.bin: the 2019–2021 FineWeb shards tokenized with… See the full description on the dataset page: https://huggingface.co/datasets/Liangzhi-Li/fineweb-124m-pretraining.

Author / organizationLiangzhi-Li
License (as declared)odc-by
Downloads187 (as reported by Hugging Face)
Likes0
Created16 October 2026
Last updated at source16 October 2026
finewebpretraininglanguage-modeling
Embed this entry
<iframe src="https://silytics.si/embed/item/9796a38f-9db2-462d-851c-e157755f110c" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

187 now (+39 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from Liangzhi-Li

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.