Dataset · Hugging Face

sail/regmix-data-sample

Name: regmix-data-sample
Creator: sail
License: mit
Keywords: language:en, license:mit, size_categories:100K<n<1M, format:json, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, arxiv:2407.01492, region:us, regmix

RegMix Data Sample Dataset Description The RegMix Data Sample is a curated dataset derived from the Pile-Uncopyrighted, specifically designed for the RegMix paper (https://huggingface.co/papers/2407.01492). This dataset aims to facilitate the automatic identification of high-performing data mixtures for language model pre-training by formulating it as a regression task. Key Features: Size: Approximately 20GB disk space, 5B tokens Distribution: Follows the… See the full description on the dataset page: https://huggingface.co/datasets/sail/regmix-data-sample.

View on Hugging FaceReport an issue

Author / organization	sail
License (as declared)	mit
Downloads	733 (as reported by Hugging Face)
Likes	2
Created	2 July 2024
Last updated at source	11 July 2024

regmix

Embed this entry

<iframe src="https://silytics.si/embed/item/13e7203b-ad68-49ab-99ab-3be0320fb6d0" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from sail

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.