Dataset · Hugging Face

Skylion007/openwebtext

Name: openwebtext
Creator: Skylion007
License: cc0-1.0
Keywords: task_categories:text-generation, task_categories:fill-mask, task_ids:language-modeling, task_ids:masked-language-modeling, annotations_creators:no-annotation, language_creators:found, multilinguality:monolingual, source_datasets:original, language:en, license:cc0-1.0, size_categories:1M<n<10M, format:parquet, modality:text, library:datasets, library:dask

Dataset Card for "openwebtext" Dataset Summary An open-source replication of the WebText dataset from OpenAI, that was used to train GPT-2. This distribution was created by Aaron Gokaslan and Vanya Cohen of Brown University. Supported Tasks and Leaderboards More Information Needed Languages More Information Needed Dataset Structure Data Instances plain_text Size of downloaded dataset… See the full description on the dataset page: https://huggingface.co/datasets/Skylion007/openwebtext.

View on Hugging FaceReport an issue

Author / organization	Skylion007
License (as declared)	cc0-1.0
Downloads	45.1K (as reported by Hugging Face)
Likes	543
Created	2 March 2022
Last updated at source	21 July 2026

Embed this entry

<iframe src="https://silytics.si/embed/item/34f2cb7b-7633-4a77-b6c3-e5821b9d47ef" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

erwanf/gpt2-miniModel · used to train

Explore this entry in the graph

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 14 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.