- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes ROAM, a training-free decoding method for mitigating hallucinations in vision-language models. ROAM first calibrates a set of reusable attention heads using entropy-based statistics across perturbed image-text inputs. During inference, the selected heads serve as read-only monitors to estimate visual grounding, which is then used to adaptively adjust the sampling temperature. Experiments across multiple models and benchmarks demonstrate improvements in hallucination mitigation with minimal inference overhead.
Critical strengths
I appreciate the authors' efforts in conducting experiments on more recent vision-language models, such as Qwen3-VL and InternVL3.5, rather than relying primarily on earlier models. The evaluation also covers both generative and discriminative hallucination benchmarks, demonstrating a relatively comprehensive experimental effort.
Critical weaknesses
-
Limited methodological novelty. The main components of ROAM, including entropy-based attention-head selection, visual-attention entropy monitoring, and adaptive temperature scaling, are relatively straightforward and closely related to existing works. Although the authors emphasize the separation of monitoring and intervention, this distinction appears primarily architectural rather than a substantial methodological advance. The paper does not sufficiently establish the unique advantages of this design beyond computational efficiency.
-
Insufficient justification for the core methodological assumptions. The method assumes that concentrated visual attention indicates stronger grounding, while diffuse attention suggests a higher hallucination risk. However, attention concentration does not necessarily imply that the model is attending to the correct visual evidence.
-
Missing critical baselines. Since ROAM primarily mitigates hallucinations by reducing the sampling temperature, comparisons with simple fixed-temperature decoding strategies are essential.
Questions for authors
no other questions