- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SCTF, a Self-Correcting Time-Frequency Diffusion framework for multivariate time-series anomaly detection. The motivation is that anomalous observations in the visible conditioning context can bias diffusion-based reconstruction, making anomalies easier to reconstruct and therefore more difficult to detect.
Critical strengths
(1) The paper identifies a relevant failure mode of conditional diffusion for anomaly reconstruction and proposes a coherent approach.
The observation that anomalous values in the visible context can affect reconstruction is clearly motivated. SCTF addresses this issue at the conditioning stage rather than only increasing reconstruction capacity. The combination of multi-view risk estimation, risk-adaptive corruption, and synchronized temporal-frequency reconstruction forms a consistent pipeline.
(2) The paper provides a broad empirical analysis.
Beyond the main benchmark results, the paper includes ablations of corruption strategies, self-correcting refinement, temporal-frequency coupling, and individual anomaly priors. It also reports risk–ground-truth alignment, hyperparameter sensitivity, three-seed stability, no-point-adjustment results, cross-domain evaluation, and model-efficiency comparisons. These experiments provide useful evidence about the contributions of different components.
Critical weaknesses
(1) The comparison is not based on uniformly reproduced baselines.
A. In Sec. 4.3, Table 1 compares SCTF with existing methods on SMAP, SMD, PSM, MSL, and SWaT under the point-adjustment (PA) protocol. However, the table caption states that baseline results are collected from published studies rather than reproduced using the authors' experimental pipeline. Appendix B.5 further clarifies that the authors use results from the original papers when available and, where applicable, adopt better results reported in subsequent studies.
B. This limitation is relevant because Table 1 provides much of the evidence for SCTF's reported performance advantage, including the highest average F1 score of 96.41 across the five benchmarks. However, Appendix B.2 indicates that the evaluation follows the PA settings of the respective sources rather than a unified experimental pipeline. Although these results share the general PA protocol, they may differ in preprocessing, window construction, data splits, threshold selection, and hyperparameter tuning. These differences make the reported performance gaps harder to interpret.
C. Appendix B.5 also excludes CATCH and CrossAD from Table 1 because their evaluation protocols differ from the adopted PA setting, which further indicates variation across published experimental configurations. Therefore, Table 1 may be better viewed as a comparison with previously reported results rather than as a controlled state-of-the-art comparison. Reproducing several representative baselines, particularly related diffusion-based methods, under the same preprocessing, windowing, thresholding, and tuning procedures would make the comparison more informative.
(2) The experimental design provides limited direct validation of the proposed core mechanism.
A. The cross-domain generalization evaluation in Sec. 4.3 and Table 2 is not entirely independent of target-domain data. According to Appendix B.1 and Table 5, SCTF is trained on STEAD and evaluated on OBST2024, DAS-MedSea, and ShipsEar with fixed model parameters and hyperparameters, without target-domain retraining. However, the detection threshold is calibrated separately for each target dataset using its validation anomaly-score distribution, as specified in Appendix B.4.
Although this unlabeled calibration is reasonable, and Table 2 also reports threshold-independent AUPRC, the setting is more accurately described as fixed-model cross-domain transfer with target-domain unlabeled threshold calibration rather than a strictly target-data-free zero-shot setting. Reporting a source-domain-only threshold or a separate target-data-free setting would make the scope of the generalization claim clearer.
B. The experiments provide only indirect evidence for SCTF's central motivating hypothesis. The Introduction and Fig. 1 argue that anomalous observations in the conditioning context can bias reconstruction toward abnormal patterns, reduce the distinction between normal and anomalous reconstruction errors, and potentially increase missed detections. Sec. 3.4 addresses this issue through risk-adaptive context corruption, where Eq. (5) applies stronger corruption to higher-risk observations to reduce their influence on reconstruction.
C. The current experimental evidence primarily evaluates downstream detection performance. In Sec. 4.4, Table 3 compares No Isolation and Hard Isolation with the risk-adaptive corruption scheme and reports F1 differences on STEAD and PSM. Appendix B.8 and Table 13 further evaluate No Isolation, Oracle Corruption, Random Isolation, Hard Isolation, Fixed Corruption, and different adaptive corruption strengths.
These results indicate that the treatment of conditioning contexts affects detection accuracy, but they do not directly test the relationship illustrated in Fig. 1: whether increasing anomaly contamination in the conditioning context biases reconstruction toward anomalous observations, reduces the anomaly reconstruction-error gap, and consequently increases missed detections.
Questions for authors
-
Related to Weakness 1: Could the authors reproduce several representative baselines from Table 1 using the same data splits, preprocessing pipeline, input-window configuration, hyperparameter-selection procedure, and thresholding strategy as SCTF? How much of the reported performance advantage remains under a more controlled setting?
-
Related to Weakness 2: Could the authors provide a more direct evaluation of the hypothesis that anomalous conditioning contexts bias reconstruction toward abnormal observations and reduce anomaly reconstruction errors? For example, if the level of anomaly contamination in the conditioning context is progressively increased while the reconstruction target is held fixed, does the anomaly reconstruction-error gap decrease, and can SCTF mitigate this effect?
Official Response to Reviewer XZty
We sincerely thank the reviewer for the thorough evaluation and constructive suggestions. We particularly appreciate the concerns regarding baseline comparability, the scope of cross-dataset transfer, and direct validation of our motivating hypothesis. We have revised the manuscript and conducted additional experiments to address these issues.
1. Unified Baseline Reproduction and Fair Comparison (W1, Q1)
Response: We agree that comparisons based on results collected from different publications may be affected by inconsistent experimental settings. To address this concern, we have reproduced all baselines using their publicly available implementations under a unified experimental protocol, rather than relying on previously reported results.
Specifically, all methods use the same training, validation, and test partitions, preprocessing, and evaluation protocol. Hyperparameters are selected using the same validation data and F1 criterion, with comparable tuning efforts. Detection thresholds are calibrated from validation anomaly scores without labels. These changes are documented in Section 4.2.
The updated Table 1 reports the results under this unified setting. SCTF achieves the highest average F1-score across the five benchmarks, although performance varies across individual datasets. These results provide a more controlled basis for comparing SCTF with existing methods, reducing the influence of differences in experimental configurations.
2. Scope of Cross-Dataset Transfer (W2-A)
Response: We agree that target-domain threshold calibration should be distinguished from a strictly target-data-free zero-shot setting.
Our experiments train SCTF on STEAD and transfer the fixed model to ShipsEar, OBST, and DAS-MedSea without target-domain retraining or hyperparameter adjustment. However, the detection threshold is calibrated separately using unlabeled validation anomaly scores from each target dataset. We have clarified this distinction in Section 4.3 and Appendix B.1.
We therefore describe the evaluation as fixed-model cross-dataset transfer with unlabeled target-domain threshold calibration, rather than strictly zero-shot detection.
The expanded Table 2 reports Precision, Recall, F1, and threshold-independent AUPRC under the unified no-PA protocol. SCTF achieves competitive results across the evaluated datasets, while other methods perform better on certain metrics or datasets. These findings provide evidence of transferability within the evaluated seismic and underwater acoustic scenarios, without implying a strictly target-data-free setting.
3. Direct Validation of Anomalous Context Contamination (W2-B/C, Q2)
Response: We appreciate the reviewer's observation that the original ablation studies primarily demonstrated downstream detection improvements without directly validating the mechanism illustrated in Fig. 1.
To address this concern, we have added a controlled experiment in Section 4.5 (Fig. 3) and Appendix B.13 (Table 18). We select anomalous reconstruction targets from 10 STEAD sequences, keeping their values and masking positions fixed while increasing the proportion of anomalous conditioning contexts from 0% to 50% and 100%.
We compare the same pretrained SCTF model under two inference configurations: (1) r=0, which disables risk-adaptive corruption, and (2) Full SCTF, which estimates context risks and applies adaptive corruption. All other reconstruction settings remain unchanged.
The average reconstruction MAE on anomalous targets is summarized below:
Without risk adaptation, increasing anomalous context contamination reduces the reconstruction error on anomalous targets, indicating that anomalous contexts can bias reconstruction toward abnormal observations and potentially weaken anomaly evidence. In contrast, Full SCTF maintains relatively stable reconstruction errors, suggesting that risk-adaptive corruption can mitigate this effect.
Fig. 3 further illustrates this trend on a representative anomalous target. These results provide direct experimental evidence for the motivating hypothesis, complementing the downstream detection results.
We sincerely appreciate the reviewer's constructive feedback. The unified baseline comparisons, clarified transfer setting, and direct context-contamination experiment have helped us improve the experimental rigor and presentation of the manuscript. We hope these revisions address the concerns and welcome further discussion!