malaiwah/fruit-phase1-shards

Fruit Phase-1 tokenized shards Pre-tokenized inputs for the GLM-5.2-SIQ-Fruit training program. Files are flat NumPy memmaps encoded with the published GLM tokenizer (vocabulary size 154,880), not Arrow/Parquet datasets; the Hugging Face row viewer is therefore not applicable. The pretraining manifest records 7,546,878,606 tokens across nine source lanes. This public repository contains 7,396,228,297 of those tokens. The 150,650,309-token code lane is intentionally omitted… See the full description on the dataset page: https://huggingface.co/datasets/malaiwah/fruit-phase1-shards.

<iframe src="https://silytics.si/embed/item/8440f8c4-a5d5-46c1-bb5b-d962e8fffe53" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.