- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces VAULT, a benchmark for low-light video anomaly understanding containing 1,776 real-world videos across four illumination levels. It supports temporal grounding, anomaly classification, anomaly description, and video question answering. The authors also propose EventVAULT, which uses synthetic event streams to guide RGB frame sampling, localize informative regions, and provide motion cues to multimodal LLMs. Experiments evaluate existing models on VAULT and demonstrate improvements with the proposed framework.
Critical strengths
- The motivation and the organisation of the paper is clear.
- The feature-space analysis provides useful evidence that normal and anomalous frames are less separable under lower illumination, offering insight into the challenges of low-light anomaly understanding and motivating the proposed approach.
- VAULT is a benchmark that addressing an underexplored setting. VAULT focuses on low-light video anomaly understanding for multimodal LLMs, with 1,776 real-world videos spanning 41.37 hours, 25 anomaly categories, and six scene types across indoor and outdoor environments.
- The benchmark supports four complementary tasks - temporal grounding, anomaly classification, anomaly description, and video question answering and groups videos into four illumination levels, enabling evaluation of multiple capabilities across lighting conditions.
Critical weaknesses
-
The introduction does not clearly define ''illumination level'' and ''RGB motion observability''. Please specify the metrics used to quantify each and the thresholds used to divide samples into groups in Figure 1.
-
The claim of being the first benchmark dedicated to low-light video anomaly understanding requires justification. In particular, the authors should discuss A2Seek [a] and ReCI [b], which supports anomaly understanding and explicitly considers low-light and nighttime scenarios, and clarify how VAULT differs in its focus and evaluation protocol. Otherwise, the novelty claim may be overstated.
-
The novelty of event-guided temporal and spatial evidence selection is insufficiently established. EventSTU [c] already uses events for RGB keyframe sampling and spatial token pruning in Video-LLMs, while event-guided RGB cropping has also been explored in EPCNet. The authors should clarify the technical differences and demonstrate the benefits of TEA and SEL over closely related strategies.
-
Given that EventSTU is closely related, the authors should consider comparing against it under matched experimental settings.
-
Video examples are not provided, making it difficult to assess the dataset’s visual quality and the challenges posed by its low-light conditions.
[a] Mo, M., Tong, X., Tan, M., Leng, J., Zheng, J., Liu, Y., Chen, H., Gan, J., Li, W. and Gao, X., 2026. A2seek: Towards reasoning-centric benchmark for aerial anomaly understanding. Advances in Neural Information Processing Systems, 38.
[b] Mo, M., Zheng, J., Leng, J. and Gao, X., 2026, June. Retrieval-Guided Contextual Inference for Training-Free Video Anomaly Detection in Low-Light Scenarios. In Proceedings of the 2026 International Conference on Multimedia Retrieval (pp. 930-939).
[c] Xu, W., Dong, X., Li, Y., Shi, H. and Xiong, Z., 2025. EventSTU: Event-Guided Efficient Spatio-Temporal Understanding for Video Large Language Models. arXiv preprint arXiv:2511.18920.
Questions for authors
-
Can the authors provide visual examples of TEA/SEL’s frame selection and spatial crops when irrelevant motion is stronger than the anomalous motion? Such examples would help assess whether the method preserves anomaly-relevant evidence despite distracting event activity.
-
How does TEA/SEL handle crowded scenes with complex, simultaneous human motions, such as retail stores where subtle theft may be overshadowed by normal customer activity? It would be great that the author can provide visualizations showing whether the selected frames and spatial crops retain the anomaly-relevant evidence in such cases.
I thank the authors for their detailed responses and additional experiments. The rebuttal has addressed my concerns regarding novelty, clarity, and experimental comparisons. I am therefore happy to raise my rating to Weak Accept.