Aquiles-ai/TinyQwen-Data

A Dataset for LLM Pre-training For details on how this dataset was used (pre-training pipeline, block packing, GPU benchmarks), see the full write-up: TinyQwen: Understanding the Pipeline for Training an LLM from Scratch TinyQwen-Data is a multilingual pre-training corpus containing approximately 15 billion tokens, designed for training compact language models in the 500M–1B parameter range. The dataset consists primarily of English text, complemented by a high-quality… See the full description on the dataset page: https://huggingface.co/datasets/Aquiles-ai/TinyQwen-Data.

<iframe src="https://silytics.si/embed/item/fd45b7fb-9ce0-45c9-a36c-592d45916902" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.