JonasGeiping/the_pile_WordPiecex32768_97b8e776baafb99c3892e6572a9f51b3

Dataset Card for the_pile_WordPiecex32768_97b8e776baafb99c3892e6572a9f51b3 This is a preprocessed, tokenized dataset for the cramming-project. Use only with the tokenizer uploaded here. This version is 97b8e776baafb99c3892e6572a9f51b3, which corresponds to a specific dataset construction setup, described below. The raw data source is the Pile, a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together.… See the full description on the dataset page: https://huggingface.co/datasets/JonasGeiping/the_pile_WordPiecex32768_97b8e776

<iframe src="https://silytics.si/embed/item/28817327-3450-42f8-9c94-18965ef70375" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 21 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.