- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes PA-OPSD, an on-policy self-distillation framework for multimodal large language models. An EMA teacher extracts visual anchors using the question, training-only reference answer, and the student's early response. These anchors guide visual masking to identify sensitive generation positions, where the student receives both contrastive output supervision and spatial attention supervision. Experiments on three backbones and eight evaluation settings show improvements over existing self-distillation baselines without changing the inference pipeline.
Critical strengths
1.Reference answers guide visual evidence localization but are excluded from subsequent teacher prediction passes. This lets the model benefit from training-time answer information while keeping the student's inputs and architecture unchanged.
2.The results show a consistent benefit on high-resolution perception: PA-OPSD obtains the best HR8K score on every evaluated backbone. This is particularly relevant to the method's focus on local visual evidence.
3.The localization analysis goes beyond attention heatmaps. Comparing equal-area masking of high-attention, low-attention, and random regions provides a useful check that the selected regions matter to model predictions.
Critical weaknesses
1.The distinction from related work needs further clarification. Although VA-OPD is discussed, VGS [1] has also studied token-level visual dependence and adaptive supervision, while Reinforced Attention Learning [2] includes on-policy attention distillation alongside output distillation.
2.The paper shows that masking the selected regions affects predictions, but does not directly show that PA-OPSD students use visual evidence more faithfully than OPSD or VCSD students.
3.The ablations do not directly establish the benefit of the shared-anchor design. Removing answer conditioning, replacing regions with random ones, or removing the attention loss shows that individual components are useful, but does not isolate the value of sharing anchors and selected positions across the two paths.
4.Eq. (5) aligns attention distributions normalized over visual tokens, so the attention loss can be small even when total visual attention is low. Spatial alignment alone does not establish stronger visual reliance. Additional evidence is needed to support the grounding interpretation of this objective.
[1] Hee Suk Yoon et al. Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding. ICML, 2026.
[2] Bangzheng Li et al. Reinforced Attention Learning. arXiv:2602.04884, 2026.
Questions for authors
Listed in the "Weaknesses" section.