Dataset · Hugging Face

bertin-project/mc4-sampling

Name: mc4-sampling
Creator: bertin-project
Keywords: task_categories:text-generation, task_categories:fill-mask, task_ids:language-modeling, annotations_creators:no-annotation, language_creators:found, multilinguality:multilingual, source_datasets:original, language:af, language:am, language:ar, language:az, language:be, language:bg, language:bn, language:ca

A sampling-enabled version of mC4, the colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: "https://commoncrawl.org". This is a version of the processed version of Google's mC4 dataset by AllenAI, in which sampling methods are implemented to perform on the fly.

View on Hugging FaceReport an issue

Author / organization	bertin-project
Downloads	168 (as reported by Hugging Face)
Likes	14
Created	2 March 2022
Last updated at source	31 October 2024

Embed this entry

<iframe src="https://silytics.si/embed/item/88854634-b403-4bb1-9507-055183a35ef3" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from bertin-project

bertin-project/mc4-es-sampledDataset
bertin-project/alpaca-spanishDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.