- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper uses a model judge to label generated responses, trains layer-specific probes to detect hallucinations, and uses intrinsic dimension to select an intervention layer. For flagged responses, it edits one token’s hidden state along a probe-guided direction. The authors report results across three vision-language models and five benchmarks.
Critical strengths
None
Critical weaknesses
-
The supervision and intervention are too coarse-grained. A response may contain both correct and hallucinated content, yet the probe receives only a response-level binary label and edits a single hidden state. The paper does not show that this intervention targets unsupported content while preserving correct content.
-
The reliability of the automatically generated labels is insufficiently validated. GPT-5-mini can misjudge image content; systematic labeling errors could affect both the probe and its editing direction. A human-audited label assessment and a noise-sensitivity analysis are needed.
-
The specificity of the learned signal is unclear. The probe may detect general errors, task difficulty, or distribution shift rather than hallucination-specific patterns. Comparisons with difficulty-matched non-hallucination errors and cross-task tests would help distinguish these explanations.
Questions for authors
- See weakness
- I think the paper’s formatting and writing need work. I hope the authors will revise it manually to reduce the signs of AI-generated writing.