jondurbin/py-dpo-v0.1

Overview DPO dataset meant to enhance python coding abilities. This dataset uses the excellent https://huggingface.co/datasets/Vezora/Tested-22k-Python-Alpaca dataset as the "chosen" responses, given this dataset was already tested and validated. The "rejected" values were generated with a mix of airoboros-l2-13b-3.1 and bagel-7b-v0.1. The rejected values may actually be perfectly fine, but the assumption here is that the values are generally a lower quality than the chosen… See the full description on the dataset page: https://huggingface.co/datasets/jondurbin/py-dpo-v0.1.

<iframe src="https://silytics.si/embed/item/24e5a051-53be-4adc-ac2f-4c18c069b223" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 20 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.