- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper examines the seemingly contradictory patterns of visual support exhibited by Vision-Language Models (VLMs) when generating object hallucinations. The authors propose STATEHALL, which measures the degree of visual support for generated objects, queried objects, and query decisions. Furthermore, the study reveals that representations of hallucinated objects receive low visual support in intermediate decoding layers—across both free-generation and object-presence query tasks—yet exhibit disproportionately high visual support during the final query decision stage. Based on these findings, the authors developed a hallucination detector by combining MCVS and STATEHALL. This detector demonstrates competitive performance and strong transferability across several models and benchmarks.
Critical strengths
-
The findings are somewhat interesting. This paper provides deeper insight into the state-dependent nature of visual support for inference in visual language models (VLMs). In particular, the different patterns of visual support observed between the object representation condition and the decision condition serve to reconcile seemingly contradictory findings from previous research.
-
The methodology is easy to follow. The proposed system is intuitive and easy to understand. Since this paper clearly describes the three numerical factors and the corresponding decomposition methods, the overall research process is straightforward and clear.
-
The experiments are relatively comprehensive. This paper investigates the proposed approach on several benchmarks and VLM architectures. It also compares the approach with existing methods and includes statistical analysis.
Critical weaknesses
-
This paper mainly focuses on the difference between free-form generation and queried object existence. While this comparison is interesting, the research scope is relatively narrow, and the results may be limited. It would be useful to investigate whether similar patterns of condition-dependent patterns emerge in other VLM tasks, such as general VQA, image captioning and multimodal reasoning.
-
Although this paper evaluates the proposed methodology with different metrics, some aspects of the exploratory analysis can be strengthened. In particular, the COCO test contains only a limited amount of discretionary information (43 for Qwen and 116 for LLaVA), which may limit the robustness of the conclusions. Furthermore, results on the RePOPE are reported only in the combined form. More detailed results (i.e., dividing into three splits) will help to verify whether the proposed method performs consistently for different scenarios and difficulty levels.
-
While this article discusses several approaches to understanding and detecting hallucinations, it ignores some recent related works [1,2,3,4,5]. A detailed discussion will help to better situate the proposed framework in the most recent literature and provide a comprehensive overview of the field.
[1] Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal Large Language Models, ICML 25.
[2] More Thinking, Less Seeing: Assessing Amplified Hallucination in Multimodal Reasoning Models, NeurIPS 25.
[3] Hallucination-aware Intermediate Representation Edit in Large Vision-Language Models, ICLR 26.
[4] Understanding and Mitigating Hallucinations in Multimodal Chain-of-Thought Models, CVPR 26.
[5] Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding, CVPR 26.
Questions for authors
See weaknesses. If the authors can successfully address my concerns, I would consider raising my ratings.