RefCaptioner: Multi-Reference Image-Grounded Video Captioning
Existing video captioning models generate natural descriptions of video content but cannot explicitly ground local visual elements to multiple reference images. We introduce multi-reference image-grounded video captioning, a new task requiring factual video descriptions with phrase-level reference grounding, and propose RefCaptioner, a two-stage post-training framework for this task. RefCaptioner combines mixed-data SFT with Hierarchical Coverage-Discounted GRPO to jointly improve reference selection, phrase-level binding, distractor rejection, and cross-reference consistency while preserving general video-captioning ability. To support training, we construct a corpus containing $20,000$ ...
| Authors | Tengfei Liu, Yang Shi, Yuran Wang et al. |
|---|---|
| Primary category | cs.CV |
| Published | 30 July 2026 |
| Last updated at source | 30 July 2026 |
Connected in the knowledge graph
- TengfeiLiuCoder/MRVBenchDataset · cited by
Models and datasets referencing this paper
- TengfeiLiuCoder/MRVBenchDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.