EleutherAI/pile_val_test
The Pile: Validation and Test Splits This repo contains the validation and test splits of The Pile, an 825 GiB English text dataset designed for training large language models. Files File Split Size val.jsonl Validation 1.4 GB test.jsonl Test 1.3 GB Format Each line is a JSON object with two fields: {"text": "The document text...", "meta": {"pile_set_name": "Pile-CC"}} The meta.pile_set_name field indicates which of the 22… See the full description on the dataset page: https://huggingface.co/datasets/EleutherAI/pile_val_test.
| Author / organization | EleutherAI |
|---|---|
| License (as declared) | mit |
| Downloads | 513 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 11 February 2026 |
| Last updated at source | 23 February 2026 |
Popularity, last 2 days
513 now (-3 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: The Pile: Validation and Test Splits This repo contains the validation and test splits of The Pile, an 825 GiB English text dataset designed for training large language models. Files File Split Size val.jsonl Validation 1.4 GB test.jsonl Te → The Pile: Validation and Test Splits This repo contains the validation and test splits of The Pile, an 825 GiB English text dataset designed for training large language models. Files File Split Size val.jsonl Validation 1.4 GB test.jsonl Te
Changes detected by Silytics between refreshes of the source.
More from EleutherAI
- EleutherAI/hendrycks_mathDataset
- EleutherAI/lambada_openaiDataset
- EleutherAI/wikitext_document_levelDataset
- EleutherAI/proof-pile-2Dataset
- EleutherAI/headqaDataset
- EleutherAI/asdivDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.