Dataset · Hugging Face

sail/regmix-data

Name: regmix-data
Creator: sail
License: mit
Keywords: language:en, license:mit, size_categories:10M<n<100M, format:json, modality:text, library:datasets, library:dask, library:mlcroissant, arxiv:2407.01492, region:us, regmix

RegMix Data Dataset Description The RegMix Data is a curated dataset derived from the Pile-Uncopyrighted, specifically designed for the RegMix paper (https://huggingface.co/papers/2407.01492). This dataset aims to facilitate the automatic identification of high-performing data mixtures for language model pre-training by formulating it as a regression task. Key Features: Size: Approximately 1TB disk space, 250B tokens Distribution: Follows the natural token… See the full description on the dataset page: https://huggingface.co/datasets/sail/regmix-data.

View on Hugging FaceReport an issue

Author / organization	sail
License (as declared)	mit
Downloads	2.8K (as reported by Hugging Face)
Likes	4
Created	2 July 2024
Last updated at source	12 September 2024

regmix

Embed this entry

<iframe src="https://silytics.si/embed/item/c9f61f5b-b653-4e14-a36d-4c5d85b22f84" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from sail

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.