OpenRLHF/preference_dataset_mixture2_and_safe_pku
Copy from https://huggingface.co/datasets/weqweasdas/preference_dataset_mixture2_and_safe_pku Reward Model Overview This is the data mixture used for the reward model weqweasdas/RM-Mistral-7B, trained with the script https://github.com/WeiXiongUST/RLHF-Reward-Modeling . Also see a short blog for the training details (data mixture, parameters...): https://www.notion.so/Reward-Modeling-for-RLHF-abe03f9afdac42b9a5bee746844518d0 Model Details If you have any… See the full description on the dataset page: https://huggingface.co/datasets/OpenRLHF/preference_dataset_mixture2_and_safe_pku.
| Author / organization | OpenRLHF |
|---|---|
| Downloads | 199 (as reported by Hugging Face) |
| Likes | 8 |
| Created | 14 June 2024 |
| Last updated at source | 14 June 2024 |
Popularity, last 2 days
199 now (-5 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.
Recent changes
- 16 Oct 2026 Description: Copy from https://huggingface.co/datasets/weqweasdas/preference_dataset_mixture2_and_safe_pku Reward Model Overview This is the data mixture used for the reward model weqweasdas/RM-Mistral-7B, trained with the script https://github.com/WeiX → Copy from https://huggingface.co/datasets/weqweasdas/preference_dataset_mixture2_and_safe_pku Reward Model Overview This is the data mixture used for the reward model weqweasdas/RM-Mistral-7B, trained with the script https://github.com/WeiX
Changes detected by Silytics between refreshes of the source.
Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.