- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Visual-Attribution Gating (VAG), which combines outcome-level RLVR supervision with token-level on-policy self-distillation for visual reasoning. A privileged teacher evaluates student-generated trajectories using an evidence-centered crop and a randomly masked version of that crop. The method retains a correction only when its sign agrees with the visual contrast between the two teacher views. Experiments shown that the proposed method can obtain improvement gains compared to previous RL methods.
Critical strengths
-The paper addresses an interesting problem, that a correct final answer does not provide precise supervision for intermediate visual decisions.
-The method is simple and introduces no additional trainable modules or inference-time burden.
-The method achieves good results on several benchmarks.
Critical weaknesses
-I have some concerns regard the novelty compared to VAD (Zhang et al., 2026). VAD already identifies mixed-source teacher corrections and uses a one-sided projection onto a visual-evidence direction to retain aligned components. In related work, it mentioned VAD but only briefly categorizes it as target reconstruction. VAG differs by applying a sign-agreement gate to corrections and incorporating them into a verifier-anchored GRPO advantage. The paper does not discuss its significance or provide a direct comparison with VAD under the same settings.
-The paper aims to learn from visual evidence that both supports and contradicts a generated token. However, Eq. 9 gives smaller weights when the visual contrast is more negative. This means that corrections that argue against a token may have very little effect, even if they pass the gate.
-The robustness of the incremental gains remains unclear. The average improvement over OPD-V is 1.32 percentage points on the 4B model, but only 0.22 points on the 9B model. No multi-seed results or uncertainty estimates are reported. Table 3 also shows substantial sensitivity to the correction weight and temperature.
K. Zhang et al. VAD: Attributing Visual Evidence for Target Reconstruction in Multimodal On-Policy Distillation. arXiv:2607.28590.
Questions for authors
See the weaknesses.