SmallDoge/SmallCorpus
SmallCorpus Overview SmallCorpus is a large-scale, multilingual dataset designed for training small language models. It includes a diverse range of text types, including web content, educational textbooks, programming code, mathematical problems, and chain-of-thought reasoning examples. The dataset is structured to facilitate both pre-training and continued pre-training of language models across multiple languages. Usage Loading… See the full description on the dataset page: https://huggingface.co/datasets/SmallDoge/SmallCorpus.
| Author / organization | SmallDoge |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 3.8K (as reported by Hugging Face) |
| Likes | 8 |
| Created | 22 April 2025 |
| Last updated at source | 18 September 2025 |
Recent changes
- 16 Oct 2026 Description: SmallCorpus Overview SmallCorpus is a large-scale, multilingual dataset designed for training small language models. It includes a diverse range of text types, including web content, educational textbooks, programming code, mathematical pro → SmallCorpus Overview SmallCorpus is a large-scale, multilingual dataset designed for training small language models. It includes a diverse range of text types, including web content, educational textbooks, programming code, mathematical pro
Changes detected by Silytics between refreshes of the source.
More from SmallDoge
- SmallDoge/stack-eduDataset
- SmallDoge/SmallTalksDataset
- SmallDoge/CDMoE_datasetDataset
- SmallDoge/MoE_datasetDataset
- SmallDoge/DMA-PretrainDataset
- SmallDoge/DogeDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.