- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes BRAID, a perspective-factorized latent reasoning framework for video anomaly understanding. It introduces separate visual and thought latent tokens for scene-state and event-dynamics information, restricts cross-perspective interactions through attention masking, and integrates the representations through contextualized latent synthesis. Training combines visual supervision derived from SAM2 and V-JEPA with teacher-generated perspective-specific texts reconstructed through an auxiliary language decoder. The supervisory components are removed at inference. Evaluation covers VAU-Bench, HIVAU-70K, UCF-Crime, and XD-Violence, including question answering, classification, description generation, and anomaly localization. Component ablations and inference latency measurements are also reported.
Critical strengths
1.The paper addresses a meaningful problem with a coherent architectural proposal. Video anomaly understanding requires integrating environmental context with temporally evolving actions and interactions. Separately organizing these cues before contextualized synthesis is a plausible approach. Transferring visual and textual knowledge through training-only supervisory components also offers potential value for deploying a compact anomaly-understanding model.
2.The reported results show promising performance for a small model. BRAID achieves 93.59% QA accuracy and 54.53% multiclass classification accuracy on VAU-Bench. On HIVAU-70K, it achieves the best results in 10 of 12 settings among the listed 2B/3B models. Table 4 also shows improvements from combining the two perspectives and introducing synthesis. These results support the framework’s practical potential, although stronger controls are needed to establish the sources of the gains.
Critical weaknesses
1.The experiments do not sufficiently validate the factorization hypothesis or isolate its contribution. The central motivation is that premature interaction between scene-state and event-dynamics information causes interference. However, Table 4 does not compare separated and shared-stream representations under identical supervision, latent-token budgets, and training conditions. A direct comparison retaining all components while removing cross-perspective masking is absent. The omission of VAU-Eval reasoning scores from the ablations further weakens the connection between the experiments and the claimed reasoning contribution.
2.Reporting inconsistencies and incomplete protocols limit confidence in the evaluation and the claimed accuracy–efficiency advantage. Several Table 1 totals do not reconcile with their displayed VAU-Eval components: BRAID’s components sum to 28.60 rather than 28.43, while VAU-R1’s sum to 22.77 rather than 24.26. Regarding efficiency, Table 6 reports only BRAID’s latency, without matched baseline measurements or a clear timing scope. Table 2 supports strong performance among the listed small models, while BRAID remains below VADER-8B on all 12 metrics. This makes an accuracy–efficiency tradeoff a reasonable contribution to investigate, but the current measurements do not substantiate the paper’s broad claim of superiority in both accuracy and computational efficiency.
Questions for authors
1.Controlled attribution of the gains. Does the Table 4 baseline receive equivalent task training, and which visual and textual supervision signals are retained in each ablation? Under matched data, supervision, training budget, and latent-token count, how does BRAID compare with a shared-stream variant without cross-perspective masking? Please also provide VAU-Eval reasoning results for the relevant variants.
2.Consistency of VAU-Eval reporting. Could the authors reconcile the component scores and totals in Table 1? Besides BRAID and VAU-R1, Qwen2.5VL-7B’s components sum to 29.65 rather than the reported 29.78. Please clarify the aggregation rule and provide consistent results.
3.Evidence for the accuracy–efficiency tradeoff. What exactly does the latency in Table 6 include—visual encoding, prefill, and/or complete answer generation—and what output length is used? Could the authors provide matched measurements against the backbone and representative direct-answer or explicit-CoT baselines? These comparisons would help assess whether BRAID’s smaller deployment model provides a meaningful efficiency advantage and appropriately qualify the superiority claim.
2 comments
Response to Reviewer i7x1 – Part 2
To Question 1: Controlled Attribution of the Gains.
Baseline Training Protocol. We clarify that the Qwen3-VL-2B baseline in Tables 1 and 4 is already fine-tuned on task-specific training data. It uses the same task training data as BRAID but without the proposed latent reasoning modules and their auxiliary supervision. Therefore, the improvements cannot simply be attributed to task-specific fine-tuning.
Details Configuration of Ablation Study. A complete description of the removed components and the visual and textual supervision signals retained in each ablation is provided in Section B.1 of the Appendix in the revised manuscript.
Ablation Study of Shared-Stream Variant. As detailed in our response to Weakness 1, we have conducted additional controlled experiments, including w/o Mask and Unified Latent (shared-stream variant), under matched data, supervision, training budgets, and latent-token counts. These experiments, together with the additional VAU-Eval reasoning ablations, provide more direct evidence for the effectiveness of our method.
To Question 2: Clarification of VAU-Eval Score.
As explained in our response to Weakness 2, the discrepancies arise because DeepSeek independently generates the five component scores and an overall score, which may not always equal their sum. We originally followed the official evaluation procedure and averaged these scores separately. To ensure consistency, we have recalculated the Total scores as the sum of the five component scores and corrected the corresponding results in Table 1, including those for BRAID, VAU-R1, and Qwen2.5-VL-7B.
To Question 3: Matched Evaluation of End-to-End Inference Efficiency.
As clarified in our response to Weakness 2, all measurements were conducted on the same hardware, and the scope of latency measurement has been explicitly specified.
As shown in Table I, we uniformly limit the maximum number of visual tokens per video frame to 256 across all methods. All methods use the same prompt for video anomaly classification, except for VAD-R1, which retains its official prompt. With 16 input frames, the average input/output token counts are 1,438/3 for Qwen3-VL-2B, 1,425/2 for HolmesVAU-2B, 2,586/217 for VAD-R1-3B, and 1,482/3 for BRAID-2B/8B.
VAD-R1 has substantially more input and output tokens because it follows a multi-step explicit reasoning process. Specifically, we retain its official prompt (approximately 960 tokens) to preserve its original reasoning procedure, and approximately 210 of its generated tokens correspond to intermediate reasoning steps. In contrast, BRAID performs deliberation in latent space without generating intermediate reasoning text. Compared with its Qwen3-VL-2B backbone, BRAID introduces only 44 additional input tokens with minimal inference overhead, while achieving substantially faster end-to-end inference than VAD-R1. These results highlight BRAID's favorable inference efficiency, with limited overhead over its backbone and substantially lower generation costs than explicit-CoT reasoning.
Response to Reviewer i7x1 – Part 1
We appreciate your valuable feedback.
To Weakness 1: Ablation Study of Shared-Stream Representations and Cross-Perspective Masking
We conduct two additional ablations, BRAID w/o Mask and Unified Latent, to evaluate the effectiveness of perspective separation. In BRAID w/o Mask, we enable cross-perspective attention while keeping all other components, supervision signals, and training settings unchanged. In Unified Latent, we retain the same total number of visual and thought tokens as BRAID but remove the distinction between scene-state and event-dynamics tokens. Specifically, shared visual latents are jointly supervised by SAM2 and V-JEPA features through learnable transformation heads, which accommodate the heterogeneous feature spaces of the two encoders and avoid directly aligning potentially incompatible supervision targets. Meanwhile, unified thought tokens are trained to reconstruct the concatenated scene-state and event-dynamics CoTs generated by the same teacher MLLM. The results are shown in Table A:
Table A: Additional ablation results of BRAID on VAU-Bench, with AUC (%) evaluated on UCF-Crime
The results show that Unified Latent underperforms BRAID by 3.47, 5.16 and 4.72 percentage points in QA, Acc and AUC, respectively, highlighting the benefits of perspective-specific latent modeling over unified representations. Moreover, removing the cross-perspective attention mask (w/o Mask) reduces QA, Acc and AUC by 1.96, 1.68 and 3.63 points, respectively, further supporting the effectiveness of restricting premature cross-perspective interactions. The VAU-Eval results of the remaining ablation experiments are provided in Table 7 of the Appendix of the revised manuscript.
To Weakness 2
Clarification of VAU-Eval Score. VAU-Eval employs DeepSeek as an LLM-based evaluator, which independently assesses five component scores and an total score for each sample. Importantly, the total score is generated through a holistic evaluation rather than directly summing the five component scores, which may lead to discrepancies between them. In our original reporting, each component score was averaged across all samples and rounded to two decimal places, while the total score was obtained by averaging the overall scores directly generated by DeepSeek. To ensure consistent reporting, we have now recalculated all VAU-Eval Total scores as the sum of the five averaged component scores. The corrected results are presented in Table 1 of the revised manuscript.
Inference Efficiency. We have additionally measured the inference latency of BRAID, Holmes-VAU, and VAD-R1 with different numbers of input frames:
Table B: Comparison of end-to-end inference latency under different input frame counts (ms). F: frame.
We measure inference latency on the same NVIDIA RTX 4090 GPU using the same input videos, covering the entire process from video loading completion to full response generation, including prompt construction, visual encoding, LLM prefill, and response generation. The results demonstrate BRAID's favorable inference efficiency compared with the evaluated baselines.
Accuracy–Efficiency Tradeoff. We acknowledge that BRAID-2B does not outperform VADER-8B on HIVAU-70K text-generation metrics. However, it achieves the best performance on anomaly-related recognition metrics, including VAU-Bench QA, anomaly classification, and VAU-Eval CLS (Table 1 in the main paper), demonstrating its ability to capture anomaly-relevant visual information. Nevertheless, BRAID-2B outperforms existing 2B VAU models on 10 of the 12 HIVAU-70K metrics (Table 2 in the main paper) and remains competitive with several 7B/8B models, although its smaller backbone may limit open-ended text generation.
We further scale BRAID to Qwen3-VL-8B. As shown in Table 2 of the revised manuscript, BRAID-8B ranks first on 8 of the 12 HIVAU-70K metrics and second on the remaining 4, outperforming VADER-8B and ReactVAU-10B on 10 metrics each. These results demonstrate BRAID's effectiveness across model scales.