thepowerfuldeez/1226_imu1_base_decay_corpus

IMU-1 Stage 2 Training Corpus (Decay Phase) Pre-tokenized training data for Stage 2 (decay phase) of IMU-1, a sample-efficient 430M parameter language model. Dataset Details Property Value Tokens ~28B Format Memory-mapped NumPy (.npy) Tokenizer SmolLM2-360M Vocab size 49,152 Data Sources Stage 2 uses tighter quality filters compared to Stage 1: DCLM-edu (higher threshold filtering) FineWeb-edu FineMath Curated high-quality sources… See the full description on the dataset page: https://huggingface.co/datasets/thepowerfuldeez/1226_imu1_base_decay_corpus.

<iframe src="https://silytics.si/embed/item/4b6a57e1-b9bf-47e1-97f6-68c381af9fd9" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.