Dataset · Hugging Face

EleutherAI/pile

Name: pile
Creator: EleutherAI
License: other
Keywords: task_categories:text-generation, task_categories:fill-mask, task_ids:language-modeling, task_ids:masked-language-modeling, annotations_creators:no-annotation, language_creators:found, multilinguality:monolingual, source_datasets:original, language:en, license:other, size_categories:100B<n<1T, arxiv:2201.07311, arxiv:2101.00027, region:us

The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together.

View on Hugging FaceReport an issue

Author / organization	EleutherAI
License (as declared)	other
Downloads	9.3K (as reported by Hugging Face)
Likes	511
Created	2 March 2022
Last updated at source	3 May 2023

Embed this entry

<iframe src="https://silytics.si/embed/item/991649c8-1646-436a-af74-86b7bf7505f7" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Connected in the knowledge graph

mradermacher/nekomata-7b-GGUFModel · used to train
EleutherAI/pythia-160m-seed3Model · used to train
EleutherAI/pythia-160m-seed5Model · used to train
RWKV/rwkv-4-3b-pileModel · used to train
mradermacher/pythia-160m-seed3-i1-GGUFModel · used to train
RWKV/rwkv-raven-7bModel · used to train
RWKV/RWKV7-G1k-13.3B-20260930Model · used to train
mradermacher/pythia-12b-i1-GGUFModel · used to train
RWKV/RWKV7-G1k-7.2B-20260930Model · used to train
EleutherAI/pythia-2.8bModel · used to train
EleutherAI/pythia-410m-seed2Model · used to train
RWKV/RWKV7-G1k-2.9B-20260930Model · used to train
ku-nlp/deberta-v3-base-japaneseModel · used to train
mradermacher/gpt-neox-20b-i1-GGUFModel · used to train
mradermacher/pythia-14m-i1-GGUFModel · used to train
EleutherAI/pythia-160m-seed8Model · used to train
BlinkDL/rwkv-4-worldModel · used to train
joeshmoethefunnyone/pythia-410m-Q4_K_M-GGUFModel · used to train
EleutherAI/pythia-410m-seed1Model · used to train
mradermacher/pythia-2.8b-GGUFModel · used to train
mradermacher/medicine-LLM-13B-GGUFModel · used to train
GeneZC/MiniMA-2-1BModel · used to train
EleutherAI/pythia-70m-seed1Model · used to train
MaziyarPanahi/medicine-chat-GGUFModel · used to train
EleutherAI/pythia-70m-seed2Model · used to train
EleutherAI/pythia-160m-seed7Model · used to train
RWKV/rwkv-4-169m-pileModel · used to train
mradermacher/gpt-neox-20b-1-GGUFModel · used to train
EleutherAI/pile-t5-baseModel · used to train
mradermacher/pythia-6.9b-GGUFModel · used to train
EleutherAI/pythia-160m-seed2Model · used to train
mradermacher/pythia-410m-GGUFModel · used to train
EleutherAI/pythia-70m-seed3Model · used to train
RWKV/RWKV7-7.2B-20260805Model · used to train
RWKV/rwkv-4-1b5-pileModel · used to train
QuantFactory/LLaMA-2-7B-32K-GGUFModel · used to train
AdaptLLM/law-LLMModel · used to train
EleutherAI/pythia-160m-seed4Model · used to train
EleutherAI/pythia-14m-dedupedModel · used to train
EleutherAI/pythia-6.9bModel · used to train

Explore this entry in the graph

More from EleutherAI

EleutherAI/hendrycks_mathDataset
EleutherAI/lambada_openaiDataset
EleutherAI/wikitext_document_levelDataset
EleutherAI/proof-pile-2Dataset
EleutherAI/headqaDataset
EleutherAI/asdivDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.