Dataset · Hugging Face

ZoeyZou/grm-reproduce-align30k-beavertails-v

Name: grm-reproduce-align30k-beavertails-v
Creator: ZoeyZou
License: cc-by-nc-4.0
Keywords: task_categories:visual-question-answering, language:en, license:cc-by-nc-4.0, size_categories:10K<n<100K, format:parquet, modality:image, modality:text, library:datasets, library:dask, library:polars, library:mlcroissant, arxiv:2503.17682, region:us, reward-modeling, multimodal

Fused GRM reproduction data This is the self-contained Stage-1 preference dataset used by GRM-Reproduce to reproduce the generative reward model (GRM) stage of Generative RLHF-V. It is an independent reproduction artifact, not an official dataset release by the paper authors. The release fuses exactly 30,000 Align-Anything pairs and 9,369 BeaverTails-V pairs. Every row already follows the final VERL Stage-1 schema produced by grlhfv_repro.data.to_verl_preference_example, and… See the full description on the dataset page: https://huggingface.co/datasets/ZoeyZou/grm-reproduce-align30k-beavertail

View on Hugging FaceReport an issue

Author / organization	ZoeyZou
License (as declared)	cc-by-nc-4.0
Downloads	384 (as reported by Hugging Face)
Likes	0
Created	9 September 2026
Last updated at source	9 September 2026

reward-modelingmultimodalpreference-datagenerative-rlhf-v

Embed this entry

<iframe src="https://silytics.si/embed/item/6fb07acb-0992-4eb3-8084-f2df43552ab8" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Popularity, last 4 days

384 now (+30 since 2026-10-16). Counts as reported by the source, snapshotted daily by Silytics.

More from ZoeyZou

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 19 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.