- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates violence anticipation by identifying behavioral cues before violent incidents occur. The authors construct a dataset of 443 pre-incident clips from XD-Violence, categorized into Normal and Risky classes. The proposed framework combines facial appearance, audio, and pose-derived motion features using separate encoders and late feature fusion. Experiments evaluate ViT-Tiny, Swin-Tiny, and DeiT-Tiny backbones with different modality combinations. The best configuration, combining all three modalities with DeiT-Tiny, achieves 91.21% accuracy, 93.65% F1-score, and 96.38% ROC-AUC. The results suggest that multimodal behavioral information can help identify elevated risk before annotated violence onset.
Critical strengths
- The paper addresses an important and challenging problem by focusing on recognizing behavioral cues before violent incidents rather than detecting violence after onset.
- The construction of pre-incident clips from XD-Violence provides a useful starting point for studying short-horizon violence anticipation.
- Combining facial appearance, audio, and body motion provides complementary information and improves the best reported performance over individual modalities.
- The experiments evaluate multiple visual backbones and modality combinations, helping analyze the contribution of different input signals.
- The use of source-video-level separation between training, validation, and test sets reduces the risk of information leakage between related clips.
Critical weaknesses
- The dataset contains only 443 clips, which limits the statistical reliability of the results and raises concerns about generalization to diverse real-world scenarios.
- The proposed architecture mainly combines existing pretrained visual encoders, temporal Transformers, an audio CNN, and late feature fusion, resulting in limited methodological novelty.
- The paper does not compare the proposed method directly with existing violence or anomaly anticipation approaches under a matched evaluation protocol.
- The annotation process lacks sufficient details about the number of annotators, inter-annotator agreement, and the reliability of the manually assigned risk levels.
- The evaluation is limited to pre-segmented clips and does not measure how early violence can be anticipated or the false-alarm rate in continuous videos.
- Some modality combinations underperform individual modalities, and the paper does not sufficiently investigate these inconsistencies or the limitations of simple concatenation-based fusion.
- The experiments are conducted on a single curated dataset without cross-dataset validation or uncertainty estimates, limiting conclusions about robustness and generalization.
Questions for authors
- How were the 443 clips distributed across training, validation, and testing, and what were the class distributions?
- How many annotators assigned the original risk labels, and was inter-annotator agreement measured?
- How does the proposed approach compare with existing violence or anomaly anticipation methods under the same dataset and evaluation protocol?
- How far before the actual incident onset can the model reliably predict elevated risk? Could the authors report performance at different anticipation horizons?
- Why do some multimodal combinations perform worse than individual modalities, particularly for ViT-Tiny and Swin-Tiny?
- Could the authors report results across multiple random seeds or confidence intervals to establish statistical reliability?
- How does the model perform on continuous untrimmed videos, where pre-incident boundaries are unknown and false alarms are important?
- How robust is the approach to missing or noisy facial detections, pose-estimation errors, and background audio interference?