xTimeCrystal/TinyCorpus-v2

Dataset Card for MiniModel Pretraining Corpus This dataset is a curated, tokenized pretraining mixture designed specifically for training MiniModel-series small language models. It was tokenized using the Mistral-7B-Instruct-v0.3 tokenizer (vocab size: 32,768), which is included in the MiniModel-200M-Base repository. For training code, data loading utilities, and full reproducibility (including the training script), see the official GitHub repository:🔗… See the full description on the dataset page: https://huggingface.co/datasets/xTimeCrystal/TinyCorpus-v2.

<iframe src="https://silytics.si/embed/item/7fe96d27-e595-4314-8514-9f375e5e29a3" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.