Dataset · Hugging Face

statmt/cc100

Name: cc100
Creator: statmt
Keywords: task_categories:text-generation, task_categories:fill-mask, task_ids:language-modeling, task_ids:masked-language-modeling, annotations_creators:no-annotation, language_creators:found, multilinguality:multilingual, source_datasets:original, language:af, language:am, language:ar, language:as, language:az, language:be, language:bg

This corpus is an attempt to recreate the dataset used for training XLM-R. This corpus comprises of monolingual data for 100+ languages and also includes data for romanized languages (indicated by *_rom). This was constructed using the urls and paragraph indices provided by the CC-Net repository by processing January-December 2018 Commoncrawl snapshots. Each file comprises of documents separated by double-newlines and paragraphs within the same document separated by a newline. The data is generated using the open source CC-Net repository. No claims of intellectual property are made on the work

View on Hugging FaceReport an issue

Author / organization	statmt
Downloads	1.3K (as reported by Hugging Face)
Likes	107
Created	2 March 2022
Last updated at source	5 March 2024

Embed this entry

<iframe src="https://silytics.si/embed/item/1b4b9004-c49f-4e59-9b5b-fbee9b94c239" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

1,294 now (-55 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

alexander-sh/mDeBERTa-v3-multi-sentModel · used to train
nomic-ai/nomic-xlm-2048Model · used to train
dsfsi/BantuBERTaModel · used to train

Explore this entry in the graph

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.