CAPEval: A Decoupled Caption Evaluation across Understanding and Generation
Captions serve as a primary supervision signal for both multimodal understanding and text-to-image generation. However, previous evaluations treat the caption quality as a single scalar objective, which conflates two distinct properties: (1) how much visual information a caption covers and (2) how reliably the image supports its stated claims. To this end, we design a decoupled caption evaluation benchmark, CAPEval (Coverage And Precision Evaluation), with human-written ground-truth captions and human-verified atomic checklist items. Specifically, CAPEval decomposes caption quality into Coverage and Precision. The former quantifies how thoroughly a caption covers ground-truth factual cont...
| Authors | Zhipeng Liu, Haochen Wang, Zhaoxiang Zhang |
|---|---|
| Primary category | cs.CV |
| Published | 3 August 2026 |
| Last updated at source | 3 August 2026 |
Models and datasets referencing this paper
- LiuzhipengUCAS/CAPEvalDataset
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.