stevenyuan666/fineweb-edu-2013-qwen2-7b

FineWeb-Edu 2013 with Qwen2-7B token counts Every 2013 FineWeb-Edu document, prepared for continued pretraining, with token counts computed by a pinned Qwen2-7B tokenizer. The pipeline is year-agnostic: the year, source revision, tokenizer contract, and selection rule all come from a config file. 2013 uses processing_config.json. 2017 is published in two forms, since that year is large enough that a ~100B token target requires shuffling and a budget rather than retaining… See the full description on the dataset page: https://huggingface.co/datasets/stevenyuan666/fineweb-edu-2013-qwen2-7b.

<iframe src="https://silytics.si/embed/item/aaea3df6-d406-4ace-bf39-d20faced768c" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.