- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies hallucination mitigation of MLLMs. The authors propose that some tasks are driven by direct visual evidence while others rely on knowledge and reasoning. To diagnose and evaluate visual and knowledge hallucinations, the authors build a benchmark, VKHalluciBench, providing broad coverage across visual- and knowledge-dominant tasks, and incorporating carefully designed open-ended questions and counter-intuition samples that are prone to induce hallucinations. The authors find that most mitigation strategies struggle balancing mitigating visual hallucinations and knowledge hallucinations. To this end, the authors further propose a plug-and-play routing-based mitigation framework.
Critical strengths
- Overall the paper is well-written and easy to understand.
- The proposed method shows improvement over baseline methods.
Critical weaknesses
Limited Novelty
-
The finding on the existence of knowledge-driven and vision-driven hallucination is not new. The conflict between visual information and knowledge prior has been studied by HallusionBench [1], VCD [2], etc. The authors define two mutually exclusive types of hallucination, whereas many VQAs rely on both visual information and knowledge. The taxonomy proposed by the authors is merely a reorganization of existing conclusions, rather than something substantially new.
-
The benchmark is merely a reorganization of existing datasets. HallusionBench [1] and PhD [3] have cover the evaluation of visual information hallucination and knowledge-driven hallucination. Counter-intuitive and open-ended evaluation is not new, either.
Insufficient findings
-
The observed trade-off, although empirically useful, is still an expected consequence of task-specific optimization instead of a fundamentally new insight.
-
The introduced diagnostic confidence does not appear to influence the routing decision, limiting the methodological significance of the proposed uncertainty handling.
-
The 99.04% diagnostic accuracy is merely about recognizing question types. There are strong patterns which can be easily captured by models. For example, predicting "visual" when reading "What color", predicting "knowledge when reading "Solve". Predicting task type does not equal to diagnosing hallucination type, either. For example, errors from math problem solving may come from OCR error. Errors from object recognizing may come from knowledge prior. Therefore, there is no strong evidence that DSP can recognize the real hallucination mechanism.
-
The 12.1% improvement is just the improvement from vanilla methods, rather than from strong baselines.
-
The authors assign SEVA for visual-dominant questions and RITUAL for knowledge-dominant questions, which is essentially a two-branch prediction.
[1] Hallusionbench: an advanced diagnostic suite for entangled language hallucination and visual illusion in large vision-language models. In CVPR, 2024.
[2] Mitigating object hallucinations in large vision-language models through visual contrastive decoding. In CVPR, 2024.
[3] Phd: A chatgpt-prompted visual hallucination evaluation dataset. In CVPR, 2025.
Questions for authors
See the weaknesses above.