recursal/DCLM-10B-Qwen2-binidx

This repository contains the DCLM-10B-Qwen2-binidx dataset, a large-scale text corpus used as training data for the RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale protocol. RADLADS proposes a method for rapidly converting traditional softmax attention transformers into efficient linear attention decoder models. This dataset is crucial for the distillation process, enabling the conversion of large language models like Qwen2.5 into linear attention variants with… See the full description on the dataset page: https://huggingface.co/datasets/recursal/DCLM-10B-Qwen2-bin

<iframe src="https://silytics.si/embed/item/361df319-52da-43c5-9bab-b425288eb282" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.