- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
STAGE is a framework for multivariate time series anomaly detection with interactive channel attribution. Each temporal window becomes a graph whose nodes represent channels. Multi-head attention and pruning construct the graph, graph convolutions model dependencies, and a permutation-invariant Deep Sets readout produces an embedding trained with a Deep SVDD objective. Channel attributions are computed from the change in anomaly score after deleting each node, with the perturbed graphs evaluated in a batch without retraining. On the 180-series TSB-AD-M evaluation subset, STAGE obtains mean VUS-PR of 0.44, matching StreamVAE among 30 baselines. Experiments on CoMuT and SMD additionally evaluate attribution quality, explanation latency, training time, and an interactive visualization tool.
Critical strengths
-
A practical integration of detection and interactive attribution. The graph representation permits channel deletion and immediate recomputation without retraining. Combining this capability with a permutation-invariant readout and an interactive interface offers a useful way for users to inspect multivariate alerts. The contribution has practical value even without a new detection objective.
-
Competitive detection across a broad benchmark. The reported VUS-PR of 0.44 matches the strongest baseline on the 180-series evaluation subset. The paper separates tuning and evaluation subsets, averages its computed metrics over five runs, and includes rank-based statistical comparisons. These experiments provide substantially stronger support for the detector than evaluation on a few selected datasets would provide (Section 5 and Appendix B).
Critical weaknesses
-
The central explanation-speed comparison does not isolate the benefit of the proposed architecture. Section 5.3 compares STAGE's batched node-deletion scores with SHAP explanations for competing detectors, reporting 0.03/0.05 ms versus 235/592 ms for StreamVAE on CoMuT/SMD. This compares different attribution procedures as well as different detectors. Reconstruction/prediction residuals can already provide inexpensive channel scores, as the related-work discussion acknowledges. Fixed-dimensional detectors can also be evaluated with batched input masking, although masking and deleting a graph node have different semantics. Without these controls, the experiments establish a large advantage over the selected SHAP implementation, but do not establish the broader claim that competing methods cannot offer real-time explanations. This distinction matters because explanation efficiency is the paper's principal advance over a detector with matching VUS-PR.
-
The diagnostic interpretation needs stronger attribution controls. Deleting a node changes the graph presented to the model and may change its aggregation statistics; permutation invariance does not establish that scores remain calibrated under such changes in graph size. The score difference is well defined as a model sensitivity, but the paper does not isolate the effect of removing anomalous channel content from generic effects of deleting a node. This matters for interpreting the scores as evidence for root-cause analysis. Attribution evaluation on CoMuT and SMD is relevant, but Appendix B.2 computes IPS over anomalies detected by each model and weights them by detected points. Different detectors can therefore be evaluated on different event subsets. A comparison on common detected events, together with a control for generic score changes caused by deletion, would provide more convincing support for the diagnostic claims. This gap affects the interpretation of the explanations, even if the detection results remain valid.
Questions for authors
-
Explanation comparison. On the existing CoMuT/SMD experiments, how does STAGE compare with native per-channel residual scores and batched channel masking for the strongest applicable baselines? Please specify the masking reference, attribution quality, common hardware, and whether the quoted times are single-window latency or amortized throughput, including the timing/synchronization procedure. A convincing advantage under these controls would materially strengthen the main contribution.
-
Diagnostic validity. What evidence distinguishes the proposed deletion scores from sensitivity to changing graph size? Can the authors report attribution quality on common detected anomaly events, with detection coverage stated, and clarify which claims concern model attribution versus causal root-cause identification? Existing CoMuT/SMD results under these controls could resolve this concern without adding a new benchmark.
We sincerely thank the reviewers for their time and thoughtful feedback. We are pleased that all reviewers acknowledged several strengths of our work and awarded high scores for its presentation.
We have already uploaded a revised version of our PDF that includes additions and improvements suggested by the reviewers. Each addition is color-coded by the reviewer that suggested it, for ease of reading. Specifically:
fgRware highlighted in BLUEXvKBZ9gH.We believe we have clarified all questions raised by the reviewers, but we remain available for further clarifications.