Dataset · Hugging Face

ecreeth/1b-smollm-corpus

Name: 1b-smollm-corpus
Creator: ecreeth
License: odc-by
Keywords: task_categories:text-generation, language:en, license:odc-by, size_categories:1M<n<10M, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, region:us, language-modeling, pretraining, small-language-model, fineweb-edu

SmolLM-Corpus — 1B Token Subset A curated 1-billion-token English pretraining corpus sampled from HuggingFaceTB/smollm-corpus, designed for training small language models (~20M parameters). Dataset Composition Source Ratio Tokens Documents FineWeb-Edu (dedup) 87% ~870M 849,577 Cosmopedia v2 13% ~130M 161,889 Total 100% ~1B 1,011,466 Rationale for the Split The 87/13 ratio mirrors the natural token distribution of the full… See the full description on the dataset page: https://huggingface.co/datasets/ecreeth/1b-smollm-corpus.

View on Hugging FaceReport an issue

Author / organization	ecreeth
License (as declared)	odc-by
Downloads	153 (as reported by Hugging Face)
Likes	1
Created	29 May 2026
Last updated at source	29 May 2026

language-modelingpretrainingsmall-language-modelfineweb-educosmopediasmollm-corpus

Embed this entry

<iframe src="https://silytics.si/embed/item/fd95f974-8747-4502-9b24-654c59efde5e" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from ecreeth

ecreeth/english-1bDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.