Dataset · Hugging Face

tiiuae/falcon-refinedweb

Name: falcon-refinedweb
Creator: tiiuae
License: odc-by
Keywords: task_categories:text-generation, language:en, license:odc-by, size_categories:100M<n<1B, format:parquet, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, arxiv:2306.01116, arxiv:2203.15556, arxiv:2107.06499, arxiv:2104.08758, arxiv:2109.07445

📀 Falcon RefinedWeb Falcon RefinedWeb is a massive English web dataset built by TII and released under an ODC-By 1.0 license. See the 📓 paper on arXiv for more details. RefinedWeb is built through stringent filtering and large-scale deduplication of CommonCrawl; we found models trained on RefinedWeb to achieve performance in-line or better than models trained on curated datasets, while only relying on web data. RefinedWeb is also "multimodal-friendly": it contains links and… See the full description on the dataset page: https://huggingface.co/datasets/tiiuae/falcon-refinedweb.

View on Hugging FaceReport an issue

Author / organization	tiiuae
License (as declared)	odc-by
Downloads	69.5K (as reported by Hugging Face)
Likes	977
Created	7 May 2023
Last updated at source	20 June 2023

Embed this entry

<iframe src="https://silytics.si/embed/item/9911b88e-a927-4248-aef8-3c944ab9c6b5" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

tiiuae/falcon-7b-instructModel · used to train
tiiuae/falcon-7bModel · used to train
chandar-lab/NeoBERTModel · used to train

Explore this entry in the graph

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.