- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PULSE, a prototype-based latent prediction framework for anomaly detection in videos. The method aims to address the limitations of conventional feature regression, which may average multiple plausible future states and consequently assign high anomaly scores to normal outcomes. Specifically, PULSE extracts visual features using a frozen encoder, then clusters normal features into prototypes, and trains a lightweight predictor to estimate the probability distribution over future prototype assignments. Anomalies are identified through latent surprise, measured by the negative log-probability of the observed prototype. Experiments on three physics anomaly detection benchmarks, Phys-AD, IPAD, and TempGlitch, show competitive performance against existing approaches.
Critical strengths
-
The paper presents a simple yet effective framework for physics anomaly detection by learning system-specific normal dynamics from videos. The use of prototype-based latent prediction provides an intuitive alternative to conventional feature regression, potentially alleviating the ambiguity caused by multiple plausible future states without requiring explicit physical rules or anomaly annotations.
-
The proposed method achieves competitive results on three physics anomaly detection benchmarks, covering industrial processes, mechanical interactions, and gameplay environments, and outperforms existing zero-shot, supervised and unsupervised baselines.
Critical weaknesses
The paper motivates prototype-based prediction as a way to address the mode-averaging problem in continuous feature regression. However, it remains unclear whether the proposed method genuinely captures multiple plausible future states, as the predicted prototype distribution is still derived from a single continuous feature representation.
Questions for authors
-
The introduction transitions abruptly from the limitations of pixel-space prediction to feature-space prediction and subsequently to prototype-based modeling, without clearly establishing the connections between these design choices. Could the authors further clarify the practical significance of the problem and provide a more coherent motivation for the proposed framework?
-
The proposed method learns normal dynamics from training videos of a particular system. Does this require training a separate predictor and constructing a new prototype vocabulary for every target environment? If so, how practical is this framework for real-world applications involving diverse or previously unseen physical systems? An evaluation of cross-system generalization would help establish its broader applicability.