Dataset · Hugging Face

HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT

Name: finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT
Creator: HuggingFaceFW
License: odc-by
Keywords: language:en, license:odc-by, size_categories:10M<n<100M, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, pretraining, smol-data

FinePDFs-Edu 50BT + DCLM 30BT + FineWeb-Edu 20BT A ~100 billion token pretraining mixture combining three high-quality English data sources in a 50-30-20 ratio, using the educational subset of FinePDFs. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Inspired by optimal dataset mixing. Dataset Description Component Source Tokens FinePDFs-Edu 100BT FinePDFs-Edu ~50B DCLM 100BT DCLM-Baseline 1.0 ~30B FineWeb-Edu 100BT… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT.

View on Hugging FaceReport an issue

Author / organization	HuggingFaceFW
License (as declared)	odc-by
Downloads	10.1K (as reported by Hugging Face)
Likes	0
Created	13 February 2026
Last updated at source	2 March 2026

pretrainingsmol-data

Embed this entry

<iframe src="https://silytics.si/embed/item/86cd5ab9-cfbb-48f3-955a-66797eaf8438" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

10,119 now (+1,091 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from HuggingFaceFW

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.