- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes AVED for hallucination mitigation in LVLMs, which include Visual Attention Calibration (VAC) and Layer-wise Logits Reweighting (LLR). VAC redistributes existing visual attention using text–visual similarities, while LLR combines layer predictions using an attention-conditioned similarity concentration score. The method requires only one full model forward pass per decoding step and reports improvements across hallucination and general VQA benchmarks.
Critical strengths
- Practically relevant direction. Combining visual attention calibration with multilayer prediction offers a useful approach to hallucination mitigation without an additional full model forward pass.
- Broad experimental coverage. The evaluation covers multiple backbones, hallucination and general VQA tasks, Gaussian image corruption, and comparisons of components and layer-confidence measures.
Critical weaknesses
- Serious inconsistencies in quantitative reporting. Tables 2 and 4 report inconsistent LLaVA-1.5 results, while incorrect averages in Tables 7, 10, and 12 understate baseline performance or overstate AVED's. These issues undermine confidence in the reported gains.
- Limited scope of VAC. A potential source of hallucination is that LVLMs allocate too little attention to visual inputs relative to text [1,2]. VAC only redistributes visual attention while preserving its total mass. Its effectiveness when visual attention is already very weak remains unclear.
- Incomplete efficiency evaluation. Table 23 omits results for the complete AVED (VAC + LLR) configuration, leaving the claimed efficiency advantage unverified.
- Poor writing and presentation. The writing lacks a clear logical progression, particularly in the fifth and sixth paragraphs of the introduction and in the method section.
Questions for authors
See Weaknesses.
References
[1] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs. ECCV 2024.
[2] Prefill-Time Intervention for Mitigating Hallucination in Large Vision-Language Models. CVPR 2026.