- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper points out that existing training-free object hallucination detection methods for LVLMs mainly rely on signals from the current generation step. To address this, the authors define a historical uncertainty term, computed as an exponentially decayed weighted average of the NLLs of preceding tokens multiplied by (t−1), and combine it with the NLL of the object’s first token to detect object hallucinations.
Critical strengths
- The method is simple and efficient, it requires no additional training or auxiliary generation and can be updated online with constant memory.
- The evaluation covers a wide range of models across diverse architectures and scales.
- The motivating analysis showing that uncertainty in earlier generated tokens is associated with hallucination is insightful.
Critical weaknesses
The core contribution is unclear.
- The proposed score consists of three components: (1) the current NLL, (2) the decoding position, and (3) the history uncertainty. The ablation in Table 4 is insufficient to determine the contribution of each component, and a substantial portion of the performance appears to come from the position term.
The experiments do not sufficiently support the main claim.
- The ℓ + log(t−1) variant is missing from the ablation in Table 4, so the main claim is not sufficiently supported.
- In Figures 2 and 6, the history-augmented risk appears to be a simple vertical shift of the instantaneous risk.
Questions for authors
- Could the authors also evaluate the method on recent LVLMs such as Qwen3.8?
- Comparing HART with the position-only baseline on short responses would help verify the core contribution.