Dataset · Hugging Face

defunct-datasets/the_pile_openwebtext2

Name: the_pile_openwebtext2
Creator: defunct-datasets
License: mit
Keywords: task_categories:text-generation, task_categories:fill-mask, task_categories:text-classification, task_ids:language-modeling, task_ids:masked-language-modeling, task_ids:text-scoring, annotations_creators:no-annotation, language_creators:found, multilinguality:monolingual, source_datasets:original, language:en, license:mit, size_categories:10M<n<100M, arxiv:2101.00027, region:us

OpenWebText2 is part of EleutherAi/The Pile dataset and is an enhanced version of the original OpenWebTextCorpus covering all Reddit submissions from 2005 up until April 2020, with further months becoming available after the corresponding PushShift dump files are released.

View on Hugging FaceReport an issue

Author / organization	defunct-datasets
License (as declared)	mit
Downloads	278 (as reported by Hugging Face)
Likes	15
Created	2 March 2022
Last updated at source	27 November 2023

Embed this entry

<iframe src="https://silytics.si/embed/item/ac9e27c9-c615-4fc0-8c15-1edf5ca76c4d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

More from defunct-datasets

defunct-datasets/eli5Dataset
defunct-datasets/amazon_reviews_multiDataset
defunct-datasets/amazon_us_reviewsDataset
defunct-datasets/the_pile_books3Dataset
defunct-datasets/bookcorpusopenDataset
defunct-datasets/the_pile_stack_exchangeDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.