Dataset · Hugging Face

UCLNLP/monoweb-dataset

Name: monoweb-dataset
Creator: UCLNLP
Keywords: task_categories:text-generation, language:en, language:de, language:es, language:fr, size_categories:100M<n<1B, format:parquet, modality:tabular, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, arxiv:2601.00364, region:us

MonoWeb Dataset MonoWeb is a multilingual pretraining corpus derived from FineWeb-Edu (English) and FineWeb2 (German, Spanish, French) by systematically removing all mixed-language documents. Released alongside the paper: The Role of Mixed-Language Documents for Multilingual Large Language Model Pretraining Dataset Structure monoweb-dataset/ ├── eng/ # Full English corpus (FineWeb-Edu) ├── deu/… See the full description on the dataset page: https://huggingface.co/datasets/UCLNLP/monoweb-dataset.

View on Hugging FaceReport an issue

Author / organization	UCLNLP
Downloads	667 (as reported by Hugging Face)
Likes	0
Created	14 April 2026
Last updated at source	23 April 2026

pretrainingmultilingualmonolingualweb-corpus

Embed this entry

<iframe src="https://silytics.si/embed/item/d768c49e-cef1-499d-a853-15937641d99f" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from UCLNLP

UCLNLP/adversarial_qaDataset
UCLNLP/sharcDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.