- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This work proposes AMR (Attention-guided Multimodal Re-reading). AMR is a training-free, plug-and-play intervention method that leverages the model’s own attention shift to identify and selectively reinforce visual evidence. It provides the model with the same image–question pair repeated consecutively. The authors notice a read-to-read redistribution of visual attention and formalize it as an attention shift. Then, to identify visual evidence, AMR tracks how visual attention changes between the two reads of the same multimodal input, identifies candidate evidence whose relevance increases, and selectively reinforces that evidence during decoding. They report multiple experiments across six MLLMs and four multimodal reasoning benchmarks, obtaining consistent gains across model scales, architectures, and task types.
Critical strengths
- AMR is a simple, training-free intervention that requires no parameter updates and is evaluated across three MLLM families and multiple model sizes.
- AMR shows consistent improvements across six different MLLMs and four multimodal reasoning benchmarks. This breadth of evaluation supports the generality of the approach across architectures, scales, and task types.
Critical weaknesses
- AMR claims that the attention shift can be exploited to identify visual evidence, but no direct evaluation of this process is provided beside the downstream answer accuracy on the benchmarks. A direct assessment of visual evidence quality would definitely be more useful to validate the ability of AMR to identify meaningful visual evidence. TreeBench provides traceable visual evidence annotations through bounding boxes, which could be used to directly assess whether the visual tokens selected by AMR align with the ground-truth evidence regions.
- Several key components remain unexplored. Table 2 compares text-only, image-only, and complete multimodal repetition, while the supplementary analysis studies the intervention strength α. However, the paper does not evaluate the sensitivity to the attention layer, the ratio-based shift metric, the median-based selection threshold, or the logarithmic bias transformation. Although these choices are motivated in the method section, comparisons with simple alternatives would help establish their contribution. The number of repeated reads and the ordering of the image and question blocks also remain unexplored.
- The comparison between the multimodal input repetition and the full AMR intervention is reported only for Qwen2.5-VL-7B. Since the reported ablation already shows that repetition alone accounts for a substantial fraction of the gains, evaluating Original vs. Repeat vs. AMR across all backbones for at least one model size would be important to establish the actual contribution of the proposed attention-guided mechanism.
Questions for authors
- Could the authors directly evaluate the quality of AMR’s visual evidence selection? TreeBench provides bounding-box annotations for the relevant visual evidence that should be used when answering the question. For example, it would be informative to measure whether the selected visual tokens or the redistributed attention mass increasingly overlap with the annotated evidence regions from the first to the second read, and after applying the AMR intervention.
- How does AMR interact with the visual attention sink phenomenon identified in prior work [1]? Kang et al. show that some visual tokens can systematically attract high attention despite containing no useful information to answer the question. Since AMR interprets read-to-read increases in visual attention as a proxy for increasing relevance, it is unclear whether some selected tokens may correspond to visual attention sinks rather than genuinely useful evidence. Figure 3 clearly shows some high attention visual tokens at the top left corner of the image that doesn’t contain any useful information for the question. Could the authors analyze the overlap between AMR-selected tokens and sink tokens, and evaluate whether explicitly filtering out sink tokens affects performance?
[1] Kang, Seil, et al. “See what you are told: Visual attention sink in large multimodal models.” International Conference on Learning Representations, 2025.