UW/olmo-mix-1124-subset-p99

This subset contains documents sampled uniformly at random from allenai/olmo-mix-1124. The longest 1% of documents in the subset are then truncated to the 99th percentile in document lengths, due to some extreme outliers in document length. The train split is used for tokenizer training, and the eval split is used for evaluating tokenizer encoding efficiency.

<iframe src="https://silytics.si/embed/item/37ffbe34-a8c7-4633-8b5e-750541416f90" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.