- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces TAI-VAD, a benchmark for persistent video anomaly monitoring. Unlike conventional clip-level evaluation, it evaluates how models behave over complete video sessions, including when to stay silent, when to issue warnings, and whether they can detect subsequent anomalies. The benchmark covers single-event, multi-event, and long-video settings. The authors also propose PACT, which fine-tunes an existing video interaction model using weighted trajectory-level supervision. Experiments show that current video interaction models struggle to balance anomaly detection and false alarms. PACT improves performance in the single-event setting, but its results on multi-event and long-video monitoring remain limited.
Critical strengths
-
The paper addresses a practical problem. Evaluating anomaly detection over complete video sessions, rather than isolated clips, makes sense for real-world monitoring applications where both timely detection and false alarms matter.
-
The benchmark brings together several existing datasets and provides a unified evaluation protocol for single-event, multi-event, and long-video scenarios. This could be a useful resource for evaluating streaming video models.
-
The experiments cover a reasonable range of video interaction models and reveal some interesting limitations, particularly the trade-off between anomaly sensitivity and false alarms. The ablation on loss weighting is also useful for understanding PACT's behavior.
Critical weaknesses
-
I am not convinced that the proposed task is fundamentally different from conventional online video anomaly detection. Existing spatio-temporal models can continuously process incoming video windows and produce binary anomaly predictions, much like online time-series anomaly detection. They can naturally handle multiple events and prolonged normal periods without requiring a new interaction formulation. Since the evaluation ultimately relies on binary silence/response decisions, it is unclear what additional capability this task actually requires.
-
Related to the above, the paper does not compare against conventional online VAD methods. Most baselines are video-language interaction models, even though standard causal or streaming VAD models could be evaluated under the same protocol. Without these comparisons, it is hard to tell whether the proposed approach offers any real advantage over existing detection methods.
-
The novelty of the semantic description component is also unclear. Previous works, such as LAVAD and Holmes-VAD, have already explored using visual descriptions and language models for video anomaly detection and understanding. While this paper emphasizes timestamp-aligned causal descriptions, their specific contribution is not isolated through ablations. More importantly, the evaluation only considers when warnings are generated, not whether their descriptions are accurate or grounded in the video.
-
PACT itself seems fairly straightforward, mainly applying weighted SFT to an existing interaction model. There is little methodological novelty beyond the training setup. Its effectiveness is also questionable in the more challenging settings: the multi-event false-positive rate is 55.08%, and long-video Recall@5s is only 3.28%. These results do not provide strong evidence that PACT successfully addresses the persistent monitoring problem it sets out to solve.
-
I also have some concerns about the evaluation design. The reported Binary AUROC is computed from binary actions and is effectively equivalent to balanced accuracy, rather than the usual AUROC based on continuous anomaly scores. Also, the coverage metric rewards repeated responses throughout an anomaly interval, although repeatedly warning about the same event may not be desirable in practice.
Overall, my main concern is that the paper does not clearly establish or separately validate the novelty of its three main components: the problem formulation, the semantic descriptions, and the PACT learning strategy. Each seems closely related to existing approaches, and the experiments do not sufficiently clarify what each component contributes beyond prior work.
Questions for authors
-
What fundamentally distinguishes the proposed persistent monitoring task from conventional online video anomaly detection? Since existing causal spatio-temporal models can continuously produce binary predictions over video streams, it is unclear what additional capability the proposed formulation requires.
-
Could the authors include conventional online or streaming VAD baselines under the same evaluation protocol? This seems important for understanding whether language-based interaction actually provides an advantage over existing detection approaches.
-
What is the specific contribution of the timestamp-aligned causal descriptions compared to existing caption-based VAD approaches? An ablation without these descriptions would help clarify their effectiveness. Also, why is the factual grounding of generated warnings not evaluated?
-
Given the high false-positive rate in the multi-event setting and the very low recall in the long-video setting, to what extent does PACT actually improve persistent monitoring? Also, does the current coverage metric appropriately reflect useful monitoring behavior, considering that repeatedly warning about the same event can increase the score?