Dataset · Hugging Face

allenai/c4

Name: c4
Creator: allenai
Keywords: task_categories:text-generation, task_categories:fill-mask, task_ids:language-modeling, task_ids:masked-language-modeling, annotations_creators:no-annotation, language_creators:found, multilinguality:multilingual, source_datasets:original, language:af, language:am, language:ar, language:az, language:be, language:bg, language:bn

C4 Dataset Summary A colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: "https://commoncrawl.org". This is the processed version of Google's C4 dataset We prepared five variants of the data: en, en.noclean, en.noblocklist, realnewslike, and multilingual (mC4). For reference, these are the sizes of the variants: en: 305GB en.noclean: 2.3TB en.noblocklist: 380GB realnewslike: 15GB multilingual (mC4): 9.7TB (108 subsets, one… See the full description on the dataset page: https://huggingface.co/datasets/allenai/c4.

View on Hugging FaceReport an issue

Author / organization	allenai
Downloads	816.6K (as reported by Hugging Face)
Likes	686
Created	2 March 2022
Last updated at source	9 January 2024

More from allenai

allenai/ai2_arcDataset
allenai/objaverseDataset
allenai/winograndeDataset
allenai/openbookqaDataset
allenai/sciqDataset
allenai/MolmoAct-Midtraining-MixtureDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.