- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CuRe, a claim-level reward framework for reinforcement learning in detailed video captioning. Rather than evaluating generated captions through holistic judgments or strict reference matching, CuRe decomposes captions into atomic visual claims and verifies their factual support directly against video evidence.
The method introduces reference-anchored credit weighting that assigns full credit to reference-matched claims, partial credit to additional video-supported claims, and zero credit to unsupported claims. Category-wise precision and recall rewards are combined to optimize a video captioner through GRPO.
The authors evaluate CuRe on three video-captioning benchmarks and through caption-based video question answering. They also replace the original captions of three training corpora containing 867K videos with CuRe-generated captions and demonstrate improvements on 25 of 27 downstream evaluation metrics. Controlled reward ablations and human evaluations provide additional evidence of improved factual accuracy and semantic coverage.
Critical strengths
-
A well-motivated reward formulation addressing incomplete reference supervision. The paper identifies an important limitation of conventional captioning rewards: details absent from a reference caption are not necessarily incorrect. The proposed claim-level verification and reference-anchored credit weighting provide a principled way to distinguish unsupported statements from valid additional visual information. This is a meaningful methodological contribution because it addresses factual reliability and semantic coverage simultaneously, rather than optimizing one at the expense of the other.
-
Strong validation extending beyond direct captioning benchmarks. The experimental design is a major strength. In addition to direct captioning evaluations, the authors demonstrate that CuRe-generated captions improve subsequent VLM pretraining across three different video-caption corpora. The improvements on 25 of 27 downstream metrics are particularly compelling because they provide evidence that the generated captions are useful as training supervision, not merely better aligned with a particular caption evaluation metric. The reward ablations and human evaluations further strengthen this conclusion.
Critical weaknesses
-
The reward formulation remains dependent on imperfect model-based visual verification. The reliability of CuRe fundamentally depends on correctly determining whether individual claims are supported by the video. Although Appendix C.5 evaluates the reward modules, the reported verification accuracy of 81.93% and false-support rate of 6.17% indicate that verification errors remain non-negligible. More importantly, the verification analysis in Appendix C.8 reports a conflicting-claim F1 of only 29.8% for the proposed category-based grouping. These results raise concerns about how reliably CuRe penalizes difficult hallucinations. The current validation uses another large VLM as the primary reference for module correctness, so the extent to which these measurements reflect independent human judgments remains uncertain. Since factual grounding is the central motivation of the method, this limitation is consequential to the paper's main claim.
-
Generalization of the reward framework beyond the selected policy and reference models is not established. The main experiments use a single policy-model backbone and reference captions from Gemini 3.0 Pro. Although the authors evaluate a smaller reward model, they do not demonstrate whether the proposed credit assignment remains effective when reference quality, reference completeness, or the policy architecture changes. This matters because the reference caption determines which claims receive full credit, while additional verified claims receive only partial credit. Consequently, differences in reference detail or systematic reference omissions could alter the reward distribution and potentially affect the learned captioning behavior. The current experiments establish effectiveness under the chosen configuration but provide limited evidence of broader reward portability.
Questions for authors
-
Given the relatively low F1 for detecting conflicting claims in Appendix C.8, how frequently do unsupported claims receive positive CuRe reward in practice? Could the authors report a human-verified analysis of false-positive reward assignments, particularly for subtle temporal, relational, and attribute-level hallucinations?
-
How sensitive is CuRe to the completeness and quality of the reference captions? In particular, would the improvements persist if the Gemini-generated reference were replaced by a shorter or less comprehensive reference source? This would help determine whether the reference-anchored weighting scheme generalizes beyond the current supervision setting.
I have decided to maintain my score and hope that all the suggested revisions will be properly incorporated into the final version of the paper.