- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper reports two patterns in VLMs: (1) attention to visual tokens is concentrated in a small set of attention heads, and (2) visual attention tends to weaken as reasoning progresses. Based on these observations, the authors propose V-ERR, a RLVR algorithm designed to encourage repeated checks of visual evidence. It first selects visual attention heads and identifies image tokens relevant to the question. During GRPO training, it gives greater weight to response tokens that show locally high attention to the selected evidence. Experiments with LLaVA and Qwen models on 5 multimodal reasoning benchmarks report marginal accuracy gains over GRPO and other baselines.
Critical strengths
1. The proposed method is easy to implement. V-ERR uses the model’s own attention patterns to adjust token-level advantages in GRPO. Its evidence selection is conditioned on the question, and it requires no additional annotations of evidence regions or reasoning steps.
2. Positive results. The main experiments show some improvements on two model families and five benchmarks.
Critical weaknesses
1. Limited support for the main hypothesis. V-ERR assumes that models use less visual evidence as reasoning continues. This claim is partly based on the rise in TFR during generation. However, this is no evidence supporting a more frequent rechecking = better performance. In other worlds, models may still use visual evidence through text positions while paying less direct attention to image positions.
2. Limited analysis of attention changes. V-ERR uses training to help models "refocusing" visual evidence during reasoning. The paper compares attention patterns before and after training: the pattern change is not consistent as shown in Figure 6. At the same time, the paper does not track TFR or evidence-checking measures at different training steps. It is therefore unclear how the intended behavior develops during training and how these changes relate to gains in accuracy.
Questions for authors
-
Could you provide evidence on more frequent rechecking = better performance?
-
Could you demonstrate the training dynamics of your proposed metrics in your baselines (e.g. GRPO) and your proposed method? Could you explain why the pattern change is not consistent in Figure 6?