Dataset · Hugging Face

EleutherAI/pile-preshuffled-seeds

Name: pile-preshuffled-seeds
Creator: EleutherAI
License: mit
Keywords: task_categories:text-generation, language:en, license:mit, size_categories:10B<n<100B, region:us, pythia, pretraining, the-pile

Pile Preshuffled Seeds This dataset contains precomputed index maps for loading the preshuffled Pile dataset with different random seeds. These index maps are used by GPT-NeoX's MMapIndexedDataset to control the order in which training data is presented to the model, enabling reproducible training with different data orders without reprocessing the underlying data. These index maps were used to train the PolyPythia model suite, which trains Pythia-scale models with multiple… See the full description on the dataset page: https://huggingface.co/datasets/EleutherAI/pile-preshuffled-seeds.

View on Hugging FaceReport an issue

Author / organization	EleutherAI
License (as declared)	mit
Downloads	812 (as reported by Hugging Face)
Likes	1
Created	12 September 2024
Last updated at source	12 February 2026

pythiapretrainingthe-pile

Embed this entry

<iframe src="https://silytics.si/embed/item/4bd186f3-1e42-44a0-b155-d49cb020a50a" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

812 now (+44 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

EleutherAI/pythia-70m-seed7Model · used to train
EleutherAI/pythia-14m-seed1Model · used to train
EleutherAI/pythia-160m-seed3Model · used to train
EleutherAI/pythia-31m-seed5Model · used to train
EleutherAI/pythia-160m-seed5Model · used to train
EleutherAI/pythia-160m-seed9Model · used to train
EleutherAI/pythia-410m-seed9Model · used to train
mradermacher/pythia-160m-seed3-i1-GGUFModel · used to train
EleutherAI/pythia-410m-seed7Model · used to train
EleutherAI/pythia-160m-seed6Model · used to train
EleutherAI/pythia-31m-seed3Model · used to train
EleutherAI/pythia-14m-seed4Model · used to train
EleutherAI/pythia-31m-seed4Model · used to train
EleutherAI/pythia-31m-seed1Model · used to train
EleutherAI/pythia-160m-weight-seed1Model · used to train
EleutherAI/pythia-410m-seed2Model · used to train
EleutherAI/pythia-410m-seed3Model · used to train
EleutherAI/pythia-70m-seed6Model · used to train
EleutherAI/pythia-410m-seed6Model · used to train
EleutherAI/pythia-160m-seed8Model · used to train
EleutherAI/pythia-70m-seed5Model · used to train
EleutherAI/pythia-410m-seed1Model · used to train
EleutherAI/pythia-14m-seed2Model · used to train
mradermacher/pythia-160m-seed2-i1-GGUFModel · used to train
EleutherAI/pythia-14m-seed9Model · used to train
EleutherAI/pythia-410m-seed8Model · used to train
EleutherAI/pythia-70m-seed1Model · used to train
EleutherAI/pythia-70m-seed2Model · used to train
EleutherAI/pythia-160m-seed7Model · used to train
EleutherAI/pythia-160m-seed1Model · used to train
EleutherAI/pythia-14m-seed3Model · used to train
EleutherAI/pythia-410m-seed5Model · used to train
EleutherAI/pythia-160m-seed2Model · used to train
EleutherAI/pythia-14m-seed5Model · used to train
EleutherAI/pythia-70m-seed8Model · used to train
EleutherAI/pythia-70m-seed9Model · used to train
EleutherAI/pythia-70m-seed3Model · used to train
EleutherAI/pythia-410m-seed4Model · used to train
EleutherAI/pythia-160m-seed4Model · used to train
mradermacher/pythia-160m-seed1-i1-GGUFModel · used to train

Explore this entry in the graph

More from EleutherAI

EleutherAI/hendrycks_mathDataset
EleutherAI/lambada_openaiDataset
EleutherAI/wikitext_document_levelDataset
EleutherAI/headqaDataset
EleutherAI/proof-pile-2Dataset
EleutherAI/asdivDataset

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.