- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SELF-SALIENCY, a post-training method that aligns a vision-language model’s visual attention with image regions mentioned in its own generated reasoning. The method identifies observation steps, grounds them using an external grounding model, and incorporates an attention-alignment reward into GRPO training. Experiments on Qwen3-VL-8B across 25 benchmarks show the highest average score and best average rank among the evaluated methods. The paper also includes comparisons with prior attention-steering approaches, ablations of the grounding targets, and analyses of changes in reasoning text and attention patterns.
Critical strengths
++ An interesting approach to reasoning-conditioned attention supervision. Deriving supervision from the model’s own observation steps allows the target regions to follow its evolving reasoning. This offers a conceptually appealing alternative to fixed, question-level supervision and provides a useful direction for improving the connection between generated reasoning and visual evidence.
++ Extensive and transparent empirical evaluation. The paper evaluates 25 benchmarks under a common evaluation protocol, includes relevant baselines and ablations, and openly reports both improvements and regressions. This breadth and transparency are substantial strengths: they provide a more informative picture of the method’s behavior and make its overall benefits and limitations easier to assess.
Critical weaknesses
-- The discussion does not adequately reconcile the overall gains with benchmark-specific regressions. The comprehensive evaluation reveals results that qualify the paper’s broader narrative about improved visual reasoning. For example, HallusionBench performance decreases from 57.1 for No-Sal to 55.7 for SELF-SALIENCY, despite the method’s motivation of better aligning reasoning with visual evidence. DailyClue and several mathematical benchmarks also decline relative to No-Sal. The current discussion focuses primarily on improvements and provides little analysis of these trade-offs. Discussing the declining benchmarks, while distinguishing effects of general post-training from those associated with the saliency objective, would make the conclusions more complete and clarify the method’s scope of applicability.
-- Concrete failure-case analysis is missing. The qualitative examples illustrate successful corrections, but the paper does not examine cases where SELF-SALIENCY fails or turns a previously correct prediction into an incorrect one. Representative examples comparing the reasoning, grounded regions, and attention maps of SELF-SALIENCY and No-Sal would help identify whether failures involve inaccurate grounding, missed visual evidence, or reasoning errors. Such analysis should be included at least in the supplementary material to give readers a clearer understanding of the method’s practical limitations.
Questions for authors
See weakness
We thank the reviewer for highlighting the paper’s strengths and for the insightful comments.
Benchmark-specific analysis
We agree that the benchmark-specific regressions deserve further analysis. We therefore examined failures on HallusionBench and DailyClue and identified a recurring pattern. In many cases, the model correctly interprets the visual evidence and reaches the correct conclusion in its reasoning. However, its final answer contradicts that conclusion or is missing. For example, the model may produce:
So the answer should be yes. <Answer>No.</Answer>These answer flips became more frequent after training. On HallusionBench, their frequency increased from 1.8% for the coldstart model (the checkpoint used to initialize training) to 10.3% for Self-Saliency. On DailyClue, it increased from 9.5% to 18.2%.
This finding highlights a distinction between errors in visual reasoning and errors in producing the final answer. We will add this analysis to the revised manuscript.
Concrete failure-case analysis
Following the reviewer’s suggestion, we have added a figure to the appendix showing several representative failure cases. These examples complement the successful cases presented in Figure 3 and illustrate practical limitations of our method.