Dataset · Hugging Face

MiniLLM/pile-diff_samp-qwen_1.8B-qwen_104M-r0.5

Name: pile-diff_samp-qwen_1.8B-qwen_104M-r0.5
Creator: MiniLLM
Keywords: task_categories:text-generation, arxiv:2410.17215, region:us

This repository contains the refined pre-training corpus from the paper MiniPLM: Knowledge Distillation for Pre-Training Language Models. Code: https://github.com/thu-coai/MiniPLM

View on Hugging FaceReport an issue

Author / organization	MiniLLM
Downloads	426 (as reported by Hugging Face)
Likes	0
Created	20 October 2024
Last updated at source	25 March 2025

Embed this entry

<iframe src="https://silytics.si/embed/item/106e1ac4-cdaa-4794-b939-fbbfed72bafc" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 2 days

426 now (+16 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Connected in the knowledge graph

mradermacher/MiniPLM-Qwen-1.2B-i1-GGUFModel · used to train
mradermacher/MiniPLM-Qwen-200M-i1-GGUFModel · used to train
mradermacher/MiniPLM-Qwen-500M-i1-GGUFModel · used to train
mradermacher/MiniPLM-Qwen-1.2B-GGUFModel · used to train
tensorblock/MiniPLM-Qwen-200M-GGUFModel · used to train
mradermacher/MiniPLM-Qwen-500M-GGUFModel · used to train
mradermacher/MiniPLM-Mamba-130M-GGUFModel · used to train
mradermacher/MiniPLM-llama3.1-212M-GGUFModel · used to train
mradermacher/MiniPLM-Qwen-200M-GGUFModel · used to train
MiniLLM/MiniPLM-Qwen-200MModel · used to train

Explore this entry in the graph

More from MiniLLM

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.