allenai/Dolci-Instruct-DPO
Dolci Instruct DPO Mixture This dataset is licensed under ODC-BY. It is intended for research and educational use in accordance with Ai2's Responsible Use Guidelines. The Dolci Instruct DPO mixture was used to preference tune Olmo 3 Instruct 7B. It contains 260,000 preference pairs in total, including: 125,000 pairs created with the preference heuristic described in Delta Learning (Geng et al. 2025) 125,000 pairs created with a delta-aware Ultrafeedback-esque GPT-judge pipeline… See the full description on the dataset page: https://huggingface.co/datasets/allenai/Dolci-Instruct-DPO.
| Author / organization | allenai |
|---|---|
| License (as declared) | odc-by |
| Downloads | 1.7K (as reported by Hugging Face) |
| Likes | 17 |
| Created | 22 October 2025 |
| Last updated at source | 20 February 2026 |
Popularity, last 3 days
1,710 now (-41 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- allenai/Olmo-3.1-32B-Instruct-DPOModel · used to train
- allenai/Olmo-Hybrid-Instruct-DPO-7BModel · used to train
- mradermacher/Olmo-3.1-32B-Instruct-DPO-i1-GGUFModel · used to train
- mradermacher/Olmo-3.1-32B-Instruct-DPO-GGUFModel · used to train
More from allenai
- allenai/c4Dataset
- allenai/ai2_arcDataset
- allenai/objaverseDataset
- allenai/winograndeDataset
- allenai/openbookqaDataset
- allenai/sciqDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.