- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Candidate-Aware Visual Counterfactual Decoding (CAVCD), which employs attention-guided visual interventions to construct a hallucination distribution and adaptively regulate the strength of contrastive decoding. Experiments on the POPE and CHAIR benchmarks demonstrate that CAVCD can effectively mitigate hallucinations in large vision-language models to some extent.
Critical strengths
None
Critical weaknesses
- The novelty of this work is limited. Contrastive decoding is a relatively mature research direction, and numerous studies have explored hallucination mitigation through input perturbations or attention interventions. In particular, methods such as SID[1] and ONLY[2] have already investigated contrastive decoding by selectively suppressing or enhancing specific modalities (visual or textual tokens). Compared with these methods, the proposed approach mainly introduces modifications to the intervention and correction strategies, without demonstrating substantial methodological novelty or providing sufficiently compelling motivation to distinguish itself from existing work.
- The experimental evaluation is not sufficiently convincing. The backbone models used in this study, such as LLaVA-1.5 and InstructBLIP, are relatively outdated, and the baselines do not adequately cover recent advances in this field. These limitations weaken the persuasiveness of the experimental results. Furthermore, I noticed that some baseline results in Table 1 differ from those reported in their original papers, and several baselines even underperform the original models in certain settings. The authors should clarify the sources of these results and provide details of the reproduction settings to ensure fair and reliable comparisons.
[1] ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models. [2] Self-Introspective Decoding: Alleviating Hallucinations for Large Vision-Language Models.
Questions for authors
no other questions