Dataset · Hugging Face

xiaodongguaAIGC/awesome-dpo

Name: awesome-dpo
Creator: xiaodongguaAIGC
Keywords: task_categories:text-generation, language:zh, language:en, size_categories:100K<n<1M, format:parquet, modality:text, library:datasets, library:pandas, library:mlcroissant, library:polars, region:us, RLHF, DPO, Reward, PPO

data source from data_name1 = 'xiaodongguaAIGC/CValues_DPO' # 110k, 30k data_name2 = 'Anthropic/hh-rlhf' # 160k data_name3 = 'PKU-Alignment/PKU-SafeRLHF-30K' # 30k filter both unsafe dataset data_name4 = 'wenbopan/Chinese-dpo-pairs' # 10k 特别处理： hh-rlhf里删除了第一个###Question saferlhf里，去除了都不安全回复

View on Hugging FaceReport an issue

Author / organization	xiaodongguaAIGC
Downloads	152 (as reported by Hugging Face)
Likes	3
Created	3 June 2024
Last updated at source	3 July 2024

RLHFDPORewardPPOPreferencefinetunesafetydpo

Embed this entry

<iframe src="https://silytics.si/embed/item/f807896c-05d6-430a-a058-fc8af4b4337d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 3 days

152 now (-4 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.