- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether reinforcement-learning-trained video models answer from the moments they attend to. Using a calibrated attention-extraction procedure over prefill attention with position debiasing, the authors show that the fraction of correct predictions unsupported by the model's own attention drops from 0.64 in the base model to about 0.47 after outcome-reward RL, and that an explicit interval IoU reward leaves this fraction unchanged.
Critical strengths
- The core idea is elegant: verifying the attended interval by restricted-context rescoring against an equal-length control window removes the need for temporal annotation, and the equal-length and correctness-gating design choices are each justified.
- The diagnostic analysis is a genuine contribution: showing that an interval IoU reward raises grounded and ungrounded predictions in the same proportion is a clear negative result about what interval supervision constrains.
Critical weaknesses
- The state-of-the-art claim is thin: the average margin over VideoRFT is 0.8 points from single training runs with no variance or significance estimates, and VideoAPR trails VideoRFT on two of the six benchmarks.
- The finding that RL leaves correct predictions ungrounded is established only on Charades-STA temporal grounding, yet the conclusion and the motivation generalize it to video reasoning broadly without testing the extraction or the finding on any other domain.
Questions for authors
- Does the Video-R1-260k RL data mixture contain Charades-STA or other temporal-grounding items with human interval annotations?
- Can you report a second training seed or a variance estimate for the main table?
- Could you validate the attention extraction against annotated spans on one non-Charades benchmark, and report an ungrounded rate on one of the six evaluation benchmarks using an independent grounding measure?