- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper argues that GRPO gives every token in a response the same credit, even though only a few tokens actually use visual evidence. It proposes GAZE-RL, which redistributes each response's advantage across tokens. Tokens whose hidden states are similar to the image features, and that are uncertain decision points, receive more credit, while the total credit per response stays the same. Experiments on Qwen2.5-VL and InternVL3.5 report gains over GRPO, DAPO, VPPO, and Video-R1 on image and video benchmarks, with additional analyses of where the credit lands.
Critical strengths
- Insightful analyses. Three analyses stand out: layer selection validated against a behavioral visual-dependency score with a shuffled-visual control (Table 12); fixed-checkpoint masking with attention and shuffled-landing controls (Table 17); and a 400-rollout audit of where negative-advantage mass lands (Table 16). They give real evidence about what the landing field selects.
- Practical. The method needs no external annotator or perception module, adds small overhead, and the code is released.
Critical weaknesses
1. The core method is the same as an uncited prior method. PEPO (arXiv 2603.22847, March 2026) already reweights token advantages by combining the similarity between response and image hidden states with token entropy. It uses the same normalization and the same blending with uniform credit, and GAZE-RL's main equations follow the same structure. The only differences are that entropy is additionally gated by a visual support term and only selected layers are used instead of all layers. PEPO is neither cited nor compared. This is consequential because the paper's main claimed contribution already exists, so its novelty narrows to the visual support gate.
2. The visual support gate is not shown to matter, and the headline evidence is selectively averaged. In the paper's own ablation, removing the visual-support gate (plain entropy weighting) costs only about 0.3 points on images and 0.9 on video, in a single run and within the range of the hyperparameter sweeps. The three-seed significance test averages only the four image benchmarks with the strongest gains. It also leaves out NExT-QA, where all RL methods fall below the base model. On InternVL3.5-8B Video-MME, GAZE-RL is 7–9 points below every RL baseline. This is consequential because, without evidence that the gate helps, the paper shows no contribution beyond PEPO.
Questions for authors
- How does GAZE-RL differ from PEPO, whose weighting matches yours almost exactly? Please provide a head-to-head comparison under identical training.
- Can you report multi-seed results for plain entropy weighting vs. the full method, and recompute the significance test over all benchmarks (including NExT-QA and the general image set)? Is the InternVL3.5-8B Video-MME entry (67.0 vs. 73.9–75.6) correct?
Thank you for your detailed and thoughtful responses. After carefully reading the responses, I believe my questions have been adequately addressed. I have no further concerns and will maintain my positive score.