- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper focuses on the medical visual hallucination detection task and finds that reported progress in medical visual hallucination detection is largely caused by benchmark shortcuts (e.g., answer length, format, and image-level leakage). It proposes a "fair protocol" with length- and type-matched negative answers, image-level splits, and language-only controls for evaluation. The paper reports that existing detectors fall to approximately chance AUROC under this protocol. The authors proposes QCE-Net, a trainable head over frozen CLIP features, and LLaVA-LoRA, a low-rank adaptation of LLaVA-Med for grounded versus ungrounded answer classification. The main claimed outcome is the collapse of prior detectors and recovery of signal by QCE-Net and LLaVA-LoRA, outperforming the baselines.
Critical strengths
- The paper aims to address an important issue: hallucination detectors may exploit answer-level shortcuts rather than image evidence.
- QCE-Net is simple and interpretable. and the experiments show that the proposed model outperforms baselines.
Critical weaknesses
-
The innovation is limited. The proposed fairness-oriented evaluation protocol and QCE-Net architecture both overlap substantially with existing work on controlled or answerability-aware VQA evaluation and question-guided or attention-based visual reasoning [1-3].
-
Positive samples are dataset ground-truth answers, while negatives are answers borrowed from other images. This measures artificial candidate-answer classification rather than natural LMM hallucinations, and borrowed answers may be synonymous, multiply valid, or clinically correct; the CLIP-based “possibly valid” check is circular and lacks clinician adjudication.
-
It would be better if the authors conducted cross-validation and reported standard deviation to demonstrate that the findings are stable.
[1]. Vardi, Ben, Oron Nir, and Ariel Shamir. "Clip-up: Clip-based unanswerable problem detection for visual question answering." 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 2026. [2] Zhang, Yudong, et al. "Dhcp: Detecting hallucinations by cross-modal attention pattern in large vision-language models." Proceedings of the 33rd ACM International Conference on Multimedia. 2025. [3] He, Xingwei, et al. "TUBench: Benchmark Large Vision-Language Models on Trustworthiness With Unanswerable Questions." IEEE Transactions on Dependable and Secure Computing (2026).
Questions for authors
- Can the model accurately detect hallucinations if negative samples also have similar anomalies? for example, to cluster the patients first and then conduct the hallucination detection.