- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper propose DEACT, a training-free method that identifies hallucination-related attention heads and dynamically regulates their text-side contributions during decoding. Experiments across multiple LVLMs and benchmarks demonstrate its effectiveness in reducing object hallucinations while largely preserving generation quality.
Critical strengths
The experiments cover multiple models and demonstrate clear advantages over baseline methods, with relatively comprehensive ablation studies.
Critical weaknesses
- Limited novelty and substantial overlap with existing attention-head intervention methods. The proposed method substantially overlaps with prior work on hallucination mitigation through attention-head interventions, such as AD-HH. Identifying hallucination-related attention heads and subsequently intervening on them has become a common paradigm. Although this paper introduces modifications to head selection and dynamic suppression strategies, these changes primarily concern implementation details rather than fundamental differences in the underlying mechanism.
- Insufficient justification for the dynamic control strategy. Section 3.1 shows that text-side reliance poorly distinguishes hallucinated from grounded predictions. However, DEACT still uses this metric to determine suppression strength, applying stronger interventions as text-side reliance increases. While diagnostic capability does not necessarily imply control effectiveness, the paper lacks sufficient justification and empirical evidence for why higher text-side reliance should warrant stronger suppression.
Questions for authors
no other questions