amd/Instella-Long

Instella-Long The Instella-Long dataset is a collection of pre-training and instruction following data that is used to train Instella-3B-Long-Instruct. The pre-training data is sourced from Prolong. For the SFT data, we use public datasets: Ultrachat 200K, OpenMathinstruct-2, Tülu-3 Instruction Following, and MMLU auxiliary train set. In addition, we generate synthetic long instruction data using documents of the books and arxiv from our pre-training corpus and the dclm subset from… See the full description on the dataset page: https://huggingface.co/datasets/amd/Instella-Long.

<iframe src="https://silytics.si/embed/item/634d37a1-04e4-4047-b2ba-9a786b1b6003" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 16 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.