zkolter/llm_speedrun
LLM Speedrun token streams Pre-tokenized training artifacts for the LLM speedrun exercises. File Description Tokens tokenizer_50M.bpe JSON-serialized BPE tokenizer — fineweb-edu-10BT.shuffle.bin Shuffled FineWeb-Edu sample/10BT token stream 9,440,023,113 smoltalk.shuffle.bin Shuffled SmolTalk data/all token stream 875,269,408 The .bin files are headerless, little-endian unsigned 16-bit token IDs and can be memory-mapped with NumPy: from huggingface_hub import… See the full description on the dataset page: https://huggingface.co/datasets/zkolter/llm_speedrun.
| Author / organization | zkolter |
|---|---|
| License (as declared) | other |
| Downloads | 464 (as reported by Hugging Face) |
| Likes | 1 |
| Created | 1 September 2026 |
| Last updated at source | 21 September 2026 |
Popularity, last 3 days
464 now (-31 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.