- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies why vision-language models may still hallucinate objects even when an image is provided. It extends the framework of Kalai and Vempala (2024) by introducing a visual evidence channel: the relevant visual information is either available to the model or erased. Under the paper’s calibration and distributional assumptions, the proposed hallucination lower bound depends on both the probability of losing visual evidence and the visual monofact rate, which measures the frequency of training facts that appear only once. The paper also presents a generator intended to match this bound. The paper further discusses attention dilution from unrelated visual tokens, the trade-off between answering questions and avoiding hallucinations, and the distinction between calibration on yes/no existence questions and calibration in free-form caption generation. Evaluation includes a controlled synthetic setting and experiments with frozen Qwen3-VL models using POPE questions and CHAIR-style caption evaluation.
Critical strengths
S1. The paper addresses an important question through a useful distinction between having an image and having usable visual evidence. The motivation is compelling: providing an image does not necessarily mean that the model’s internal representation retains the information needed to verify a statement. Connecting this limitation with incomplete coverage of training facts offers an interesting perspective on object hallucination. I find this a worthwhile direction for theoretical investigation, even though the applicability of the proposed model needs further justification. S2. The distinction between yes/no probing and free-form generation is valuable for interpreting evaluation results. The paper explains that reliable existence predictions do not automatically imply reliable object mentions in generated captions. It also separates abstention from incorrect answers, making clear that reducing errors can come at the cost of answering fewer questions. These distinctions are useful when interpreting claims about hallucination reduction across different evaluation settings.
Critical weaknesses
W1. The connection between the theoretical assumptions and practical vision-language models is not sufficiently established. The central erasure assumption is quite strong: the visual representation either determines whether a statement is true or provides no information about its truth. I understand why this assumption makes the analysis more tractable. However, I am less clear about how the resulting conclusions apply when the visual representation provides useful but incomplete evidence. The discussion of alternative channels in Appendix E is helpful, but the paper should more clearly distinguish conclusions specific to hard erasure from those that extend to these less idealized settings. W2. The empirical evidence does not adequately support the strength of the quantitative claims. The synthetic experiments use the proposed matching generator, whose probability of drawing from the false pool is explicitly set using the monofact rate. These experiments are useful for illustrating the construction and checking its numerical behavior. However, because the mechanism being tested is built into the generator, the close agreement should be distinguished from independent evidence that trained vision-language models follow the same quantitative relationship. For the real-model experiments, Table 8 on page 32 reports a CHAIR-style hallucination rate of 0.276 against a proxy lower bound of 0.026 for the 224-pixel condition. The corresponding values are 0.279 versus 0.019 for the 448-pixel condition, and 0.307 versus 0.037 for the four-image condition. These observations are above the estimated lower bound, but that is different from showing that the bound closely describes the measured hallucination rates. I do not regard this gap as a contradiction of a lower bound, and a bound that is attainable by a constructed generator need not be attained by a deployed model. My concern is instead with the presentation: the abstract and conclusion appear to extend the claim of agreement within one percent to the frozen-model experiments. I could not identify the corresponding real-model slope analysis supporting that statement. The paper should clearly separate numerical agreement in the synthetic setting, qualitative consistency in real models, and evidence that real models approach the proposed bound.
Questions for authors
Q1. What are the main new technical contributions beyond the existing text-only result?
Section 4 describes the main argument as applying Kalai and Vempala’s result when visual evidence is erased and then combining that case with the visible case. The paper also introduces attention and coverage analyses. It would help to distinguish more explicitly which steps require new arguments, which follow from the existing result, and which depend on additional modeling assumptions. This would make the significance of the visual extension easier to assess.
Q2. How does the matching construction account for familiar objects that are absent from the current image?
Appendix H notes that replaying “cat” or “dog” on an image containing only a toaster is still an error, even though these objects appeared in training. I would appreciate an explanation of how such errors are included in the matching-generator analysis. In particular, how should readers reconcile these errors on observed facts with the claim that the generator matches a bound based on the monofact rate? A concrete explanation using the existing worked example would be helpful.
Q3. Can the distractor-image comparison be reported on a matched set of target images?
Table 8 uses 200 images for the single-image conditions but 60 for the four-image condition. Please clarify whether the reported increase in hallucination also holds when comparing the same 60 target images with and without distractors. Reporting uncertainty estimates would help readers assess the reliability of this difference.
Q4. Could you provide some specific case studies to help readers better visualize how hallucinations change (for example, how hallucinations change or appear when visual information is removed)?