HuggingFaceFW/finepdfs_100BT
FinePDFs 100BT A ~100 billion token English subset of FinePDFs (eng_Latn split), created for efficient pretraining experiments. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Dataset Description This dataset was created by randomly sampling from the English split of FinePDFs (~726B tokens) to produce a ~100B token subset. Sampling was performed with a fixed seed (42) and a slight 1.05× oversampling factor to account for variance.… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceFW/finepdfs_100BT.
| Author / organization | HuggingFaceFW |
|---|---|
| License (as declared) | odc-by |
| Downloads | 1.4K (as reported by Hugging Face) |
| Likes | 2 |
| Created | 11 February 2026 |
| Last updated at source | 2 March 2026 |
Recent changes
- 16 Oct 2026 Description: FinePDFs 100BT A ~100 billion token English subset of FinePDFs (eng_Latn split), created for efficient pretraining experiments. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Dataset Description This datas → FinePDFs 100BT A ~100 billion token English subset of FinePDFs (eng_Latn split), created for efficient pretraining experiments. Part of the Smol-Data collection — tried and tested mixes for strong pretraining. Dataset Description This datas
Changes detected by Silytics between refreshes of the source.
More from HuggingFaceFW
- HuggingFaceFW/fineweb-eduDataset
- HuggingFaceFW/finewebDataset
- HuggingFaceFW/fineweb-2Dataset
- HuggingFaceFW/finephraseDataset
- HuggingFaceFW/finepdfsDataset
- HuggingFaceFW/finetranslationsDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.