- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes HalluGuard, a decoupled framework for evaluating and mitigating hallucinations in MLLMs. The main component, named AutoEval, checks generated descriptions through separate visual perception tasks and provides fine-grained feedback. Its inference-time mitigation module uses this feedback to revise hallucinated content without model updates. Several experiments shows high agreement with human judgments and reveal that shorter responses can misleadingly improve hallucination scores.
Critical strengths
- The AutoEval and IHM frameworks are well described.
- The paper is easy to understand.
- The experimental results offer valuable insights.
Critical weaknesses
- The paper lacks a sufficient methodological contribution.
- AutoEval is the main component, but its novelty over previous hallucination detectors [1][2] is unclear. Comparisons with existing detection methods are insufficient.
[1] Unified Hallucination Detection for Multimodal Large Language Models, ACL 2024.
[2] ZINA: Multimodal Fine-grained Hallucination Detection and Editing, CVPR 2026.
- The evaluation is on only 500 images from a single dataset, which is insufficient to adequately assess the generalizability.
- The author should evaluate on standard benchmarks like POPE, AMBER, HallusionBench, and MMHal-Bench.
Questions for authors
See Weaknesses.