Dataset · Hugging Face

gmongaras/EleutherAI_the_pile_deduplicated

Name: EleutherAI_the_pile_deduplicated
Creator: gmongaras
Keywords: size_categories:100M<n<1B, format:parquet, modality:text, library:datasets, library:dask, library:mlcroissant, library:polars, region:us

Since The Pile was removed from the original site, I'm worried this dataset might be taken down too. Putting it here just in case. Original repo: https://huggingface.co/datasets/EleutherAI/the_pile_deduplicated

View on Hugging FaceReport an issue

Author / organization	gmongaras
Downloads	852 (as reported by Hugging Face)
Likes	5
Created	30 December 2023
Last updated at source	31 December 2023

Embed this entry

<iframe src="https://silytics.si/embed/item/43329abd-f3a4-4afc-817c-4a5fda15a66b" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

852 now (+156 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from gmongaras

gmongaras/SlimPajama-627B_ReuploadDataset
gmongaras/Imagenet21K_RecaptionDataset
gmongaras/Imagenet21KDataset
gmongaras/Stable_Diffusion_3_RecaptionDataset
gmongaras/BERT_Base_Cased_512_Dataset_MappedDataset
gmongaras/BERT_Base_Cased_128_DatasetDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.