ViratGarg/pile_filtered_13B

Pile 13B tokens: filtered Filtered half of a token-matched pair; the other half is pile_unfiltered_13B. Built from shards 0-269 of EleutherAI/the_pile_deduplicated for a controlled comparison: the same GPT-2-small model trained on filtered vs. unfiltered data. Token-matched by construction. For every source shard i: pile_filtered_13B holds the documents kept by the filtering pipeline for shard i; pile_unfiltered_13B holds a random sample of raw documents from the same shard i… See the full description on the dataset page: https://huggingface.co/datasets/ViratGarg/pile_filtered_13B.

<iframe src="https://silytics.si/embed/item/3db5727e-77b0-42a9-97b7-0d56c60c2b50" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.