mlabonne/orpo-dpo-mix-40k
ORPO-DPO-mix-40k v1.2 This dataset is designed for ORPO or DPO training. See Fine-tune Llama 3 with ORPO for more information about how to use it. It is a combination of the following high-quality DPO datasets: argilla/Capybara-Preferences: highly scored chosen answers >=5 (7,424 samples) argilla/distilabel-intel-orca-dpo-pairs: highly scored chosen answers >=9, not in GSM8K (2,299 samples) argilla/ultrafeedback-binarized-preferences-cleaned: highly scored chosen answers >=5… See the full description on the dataset page: https://huggingface.co/datasets/mlabonne/orpo-dpo-mix-40k.
| Author / organization | mlabonne |
|---|---|
| License (as declared) | apache-2.0 |
| Downloads | 754 (as reported by Hugging Face) |
| Likes | 314 |
| Created | 17 April 2024 |
| Last updated at source | 17 October 2024 |
Popularity, last 4 days
754 now (-36 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- mradermacher/Medichat-Llama3-8B-GGUFModel · used to train
- mlabonne/NeuralDaredevil-8B-abliteratedModel · used to train
- tensorblock/gemma-2-9b-neogenesis-ita-GGUFModel · used to train
- wyan/NeuralDaredevil-8B-abliterated-Q4_K_M-GGUFModel · used to train
- mradermacher/CalmeRys-78B-Orpo-v0.1-GGUFModel · used to train
- mradermacher/Trixster-MoE-14B-A8B-v1-GGUFModel · used to train
- mradermacher/danube2-1.8b-Neural-GGUFModel · used to train
- mradermacher/gemma-2-2b-jpn-it-abliterated-17-ORPO-i1-GGUFModel · used to train
- QuantFactory/miscii-14b-1028-GGUFModel · used to train
- fairy322/Llama-3-8B-Instruct-abliterated-dpomix-GGUFModel · used to train
- mradermacher/gemma-2-9b-neogenesis-ita-GGUFModel · used to train
- bartowski/UNA-ThePitbull-21.4B-v2-GGUFModel · used to train
- mradermacher/gemma-2-2b-neogenesis-ita-GGUFModel · used to train
- dfurman/Llama-3-8B-Orpo-v0.1Model · used to train
- mradermacher/gemma-2-2b-ORPO-jpn-it-abliterated-18-GGUFModel · used to train
- mradermacher/gemma-2-2b-ORPO-jpn-it-abliterated-18-merge-i1-GGUFModel · used to train
- mradermacher/shunya-0.5b-instruct-GGUFModel · used to train
- mradermacher/Llama-3-70B-Orpo-v0.1-GGUFModel · used to train
- mradermacher/UNA-ThePitbull-21.4B-v2-i1-GGUFModel · used to train
- mradermacher/NeuralDaredevil-8B-abliterated-GGUFModel · used to train
- mradermacher/NeuralLlama-3-8B-Instruct-abliterated-GGUFModel · used to train
- mradermacher/gemma3-27b-abliterated-dpo-GGUFModel · used to train
- mradermacher/gemma-2-2b-ORPO-jpn-it-abliterated-18-merge-GGUFModel · used to train
- swap-uniba/LLaMAntino-3-ANITA-8B-Inst-DPO-ITA_GGUFModel · used to train
- mradermacher/OrpoLlama3-8B-i1-GGUFModel · used to train
- mradermacher/NeuralLlama-3-8B-Instruct-abliterated-i1-GGUFModel · used to train
- mradermacher/OrpoLlama-3-8B-i1-GGUFModel · used to train
- mradermacher/NeuralDaredevil-8B-abliterated-i1-GGUFModel · used to train
- nitsuai/llama-3-neural-chat-v1-8b-GGUFModel · used to train
- thunderdick/NeuralDaredevil-8B-abliterated-GGUFModel · used to train
- mradermacher/miscii-14b-1028-GGUFModel · used to train
- mradermacher/miscii-14b-1028-i1-GGUFModel · used to train
- mradermacher/LLaMAntino-3-ANITA-8B-Inst-DPO-ITA-GGUFModel · used to train
- swap-uniba/LLaMAntino-3-ANITA-8B-Inst-DPO-ITAModel · used to train
- mradermacher/BuddyGlassUncensored2025.2-i1-GGUFModel · used to train
- mradermacher/NeuralLLaMa-3-8b-ORPO-v0.3-i1-GGUFModel · used to train
- mradermacher/gemma-2-2b-jpn-it-abliterated-18-ORPO-GGUFModel · used to train
- mradermacher/Neos-Phi-3-14B-v0.1-GGUFModel · used to train
- mradermacher/gemma-2-2b-jpn-it-abliterated-18-ORPO-i1-GGUFModel · used to train
- mradermacher/gemma-2-2b-ORPO-jpn-it-abliterated-18-i1-GGUFModel · used to train
Recent changes
- 17 Oct 2026 Description: ORPO-DPO-mix-40k v1.2 This dataset is designed for ORPO or DPO training. See Fine-tune Llama 3 with ORPO for more information about how to use it. It is a combination of the following high-quality DPO datasets: argilla/Capybara-Preferences: → ORPO-DPO-mix-40k v1.2 This dataset is designed for ORPO or DPO training. See Fine-tune Llama 3 with ORPO for more information about how to use it. It is a combination of the following high-quality DPO datasets: argilla/Capybara-Preferences:
Changes detected by Silytics between refreshes of the source.
More from mlabonne
- mlabonne/harmless_alpacaDataset
- mlabonne/harmful_behaviorsDataset
- mlabonne/FineTome-100kDataset
- mlabonne/open-perfectblendDataset
- mlabonne/guanaco-llama2-1kDataset
- mlabonne/Evol-Instruct-Python-26kDataset
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.