pietrolesci/pile-deduped-subset
This dataset has been created as an artefact of the paper Causal Estimation of Memorisation Profiles (Lesci et al., 2024). More info about this dataset in the related collection Memorisation-Profiles. Sample from the Pile (EleutherAI/pile-deduped-pythia-preshuffled) used in the experiments. The unique sequence identified (seq_idx) is simply the order of the sequence in the Pile. The dataset is already tokenized.
| Author / organization | pietrolesci |
|---|---|
| Downloads | 158 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 7 February 2024 |
| Last updated at source | 9 April 2025 |
Popularity, last 4 days
158 now (-1 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
More from pietrolesci
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.