Dataset · Hugging Face

EleutherAI/the_pile_deduplicated

Name: the_pile_deduplicated
Creator: EleutherAI
Keywords: size_categories:100M<n<1B, format:parquet, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, region:us

View on Hugging FaceReport an issue

Author / organization	EleutherAI
Downloads	15.2K (as reported by Hugging Face)
Likes	120
Created	2 December 2022
Last updated at source	2 December 2022

Embed this entry

<iframe src="https://silytics.si/embed/item/9aedcd62-464e-4de6-be30-1d7d6e170e49" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

EleutherAI/pythia-70m-dedupedModel · used to train
EleutherAI/pythia-160m-dedupedModel · used to train
EleutherAI/pythia-410m-dedupedModel · used to train

Explore this entry in the graph

More from EleutherAI

EleutherAI/hendrycks_mathDataset
EleutherAI/lambada_openaiDataset
EleutherAI/wikitext_document_levelDataset
EleutherAI/proof-pile-2Dataset
EleutherAI/headqaDataset
EleutherAI/asdivDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 15 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.