Dataset · Hugging Face

krisbailey/cosmopedia-10B

Name: cosmopedia-10B
Creator: krisbailey
License: odc-by
Keywords: task_categories:text-generation, language:en, license:odc-by, size_categories:10M<n<100M, format:parquet, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, arxiv:2402.13753, region:us, cosmopedia, synthetic, 10B

Cosmopedia 10B Dataset Description This is a 10.53 Billion token subset of the HuggingFaceTB/cosmopedia dataset. It was created by sampling approximately 45% of each subset (web_samples, stories, stanford, etc.) from the original dataset and deduplicating to ensure high utility. Motivation The original Cosmopedia dataset is massive (~25B+ tokens) and high quality. This 10B version serves as a "Goldilocks" dataset—large enough for meaningful pre-training… See the full description on the dataset page: https://huggingface.co/datasets/krisbailey/cosmopedia-10B.

View on Hugging FaceReport an issue

Author / organization	krisbailey
License (as declared)	odc-by
Downloads	165 (as reported by Hugging Face)
Likes	0
Created	11 January 2026
Last updated at source	22 January 2026

cosmopediasynthetic10Bparquetlarge-text-corpusgeneral-textweb-crawlcleaned-textpretraining-dataunsupervised-learningnlpopen-datasetlanguage-model-training

Embed this entry

<iframe src="https://silytics.si/embed/item/75afb8f6-2193-4bab-b614-96c2b4e42522" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from krisbailey

krisbailey/RedPajama-Data-V2-1BDataset
krisbailey/fineweb-edu-1BDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.