fracagnetta/tinystories.BPE8192
TinyStories — BPE8192 (pre-tokenized) A pre-tokenized version of the TinyStories V2 (GPT-4) corpus, encoded with a byte-pair-encoding (BPE) tokenizer trained on the dataset itself with a target vocabulary size of 8192. The token streams are stored as flat int32 NumPy arrays, ready to be memory-mapped and sliced into context windows for training small language models. Stories are separated by a single <eos> token (id 1). Files File Description… See the full description on the dataset page: https://huggingface.co/datasets/fracagnetta/tinystories.BPE8192.
| Author / organization | fracagnetta |
|---|---|
| License (as declared) | mit |
| Downloads | 126 (as reported by Hugging Face) |
| Likes | 0 |
| Created | 10 June 2026 |
| Last updated at source | 10 June 2026 |
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.