- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the "decoded-answer rank compression" problem in unsupervised anomaly detection. It compares Decoded-Answer Scoring (DEC) with Probability-Weighted Scoring (PROB). Experiments conducted on four benchmark datasets, four VLMs, and seven answer scales show that using PROB consistently leads to performance improvements. It is demonstrated that PROB can retain the ranking information in the output distribution of visual language models (VLMs).
Critical strengths
- This paper reveals a frequently overlooked issue in anomaly detection based on VLM; there is a mismatch between discrete output and continuous anomaly ranking metrics.
- Extensive comparative experiments and detailed ablation studies effectively demonstrated and evaluated the impact of the scoring strategy.
Critical weaknesses
- The PROB method relies on the logarithmic likelihood values of the sequence, and this metric may be affected by the change in the length of the answer tokens. This effect is particularly evident in the numerical rating scale.
- The experiment failed to clearly determine whether the improvement in video detection performance was due to the improvement in "internal anomaly localization" or the enhancement of "cross-video ranking" ability. Moreover, the computational cost brought about by evaluating a large number of candidate answers has not been quantified.
- The proposed probability-weighted scoring method in this paper is conceptually more intuitive and heuristic. The paper should further clarify the innovations and discuss the related works on "anomaly unawareness" and "illusion", including AA-CLIP (CVPR 2025), Alert-CLIP (CVPR 2026), and VAD-DPO (NeurIPS 2025), etc.
- Additionally, there is an error in the citation of VADTree. It is incorrectly labeled as published in 2026, but in fact, this achievement was published in NeurIPS 2025.
Questions for authors
- How does PROB perform in cases involving multiple token numerical answers?
- Can the authors separate within-video from cross-video ranking improvements and report the inference latency and memory overhead across different answer scales?
- How does rank compression relate to limitations in underlying anomaly perception, such as anomaly-unawareness or co-occurrence hallucinations? Can improved probability-based ranking compensate for systematic semantic biases? Additionally, could the authors verify the accuracy of the references, particularly the publication year of VADTree (NeurIPS 2025)?