SlayerLab/slayer139-pretrain-mix-24k

Slayer139 pretraining mix (tok24k) Summary A pre-tokenized English pretraining mix: 26 882 183 219 tokens in 24 binary shards of uint16 token ids, produced with the tok24k tokenizer (vocab 24 576, included as tokenizer.json, sha256 prefix afeb22b4). It was used to train the Slayer139 model (139 279 760 parameters). No quality or benchmark claims are made here. The release contains only token ids, not raw text. Token ids can be decoded back to text, so the licences… See the full description on the dataset page: https://huggingface.co/datasets/SlayerLab/slayer139-pretrain-mix-24k.

<iframe src="https://silytics.si/embed/item/69228b51-d3c5-44ca-b4e6-b621e235729c" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.