Dataset · Hugging Face

HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled

Name: finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Creator: HuggingFaceFW
License: odc-by
Keywords: language:en, license:odc-by, size_categories:10M<n<100M, format:parquet, format:optimized-parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, pretraining, smol-data

FinePDFs 50BT + DCLM 30BT + FineWeb-Edu 20BT (Shuffled) A globally shuffled version of HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Dataset Description This dataset contains the same ~100B token mixture (50B FinePDFs + 30B DCLM + 20B FineWeb-Edu) but with all documents globally shuffled (seed=42). Use this version when you need randomized document ordering for pretraining… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20B

View on Hugging FaceReport an issue

Author / organization	HuggingFaceFW
License (as declared)	odc-by
Downloads	710 (as reported by Hugging Face)
Likes	7
Created	15 February 2026
Last updated at source	2 March 2026

pretrainingsmol-data

Embed this entry

<iframe src="https://silytics.si/embed/item/865ada64-dd97-41c4-98ff-ebcf61a87be7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 5 days

710 now (-60 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Recent changes

16 Oct 2026 Description: FinePDFs 50BT + DCLM 30BT + FineWeb-Edu 20BT (Shuffled) A globally shuffled version of HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Dataset Descrip → FinePDFs 50BT + DCLM 30BT + FineWeb-Edu 20BT (Shuffled) A globally shuffled version of HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Dataset Descrip

Changes detected by Silytics between refreshes of the source.

More from HuggingFaceFW

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.