- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper casts sensor-fault robustness of learned virtual sensors as a detect–isolate–accommodate pipeline: an anomaly detector flags faulty input channels, which are zeroed before a ModernTCN predictor trained with random input-channel dropout. Finding that recent time-series anomaly detectors (CATCH, CrossAD, ALoRa) localize faulty channels poorly, it proposes ITX, an iTransformer reconstruction model with untied per-channel embeddings/heads and no instance normalization, trained to recover clean windows after random channels are swapped with those of other batch samples. On the MuViS-C benchmark (nine datasets, ten synthetic single-channel failure modes), ITX gives the best channel localization and, as a gate, the best mean rank against MuViS-C's robustified baselines, with a supplementary localization check on SMD.
Critical strengths
- The one genuinely new contribution is empirical: a benchmark-scale test of modern anomaly detectors as channel isolators, scored both by which channel they flag and by a downstream virtual sensor's error between naive and oracle gates, which shows a per-channel 3σ chart ranking ahead of CATCH, CrossAD and ALoRa (Table 2). It is new evidence rather than a new idea, since simple baselines are known to rival deep detectors [1] and Fu & Yan already evaluated a sensor fault-isolation pipeline by a downstream estimator's error [2].
- The paper is clearly written: the pipeline, isolation protocol and metrics are precisely specified, and the appendices candidly report per-mode and per-severity results, false-alarm costs on clean data, test-set capping, and the upper-bound nature of the SMD protocol, with code released.
References
- [1] M. S. Sarfraz et al. Position: Quo Vadis, Unsupervised Time Series Anomaly Detection? ICML 2024, PMLR 235:43461–43476.
- [2] Y. Fu and W. Yan. One Masked Model is All You Need for Sensor Fault Detection, Isolation and Accommodation. IJCNN 2024 (arXiv:2403.16153).
Critical weaknesses
- ITX's key ingredients are established yet uncited: cross-instance substitution is VIME's marginal-resampling corruption, motivated the same way (harder to spot than zeros or noise) [3] and also used by SCARF [4]; per-sensor embeddings with per-sensor deviation scores are central to GDN [5]; and validating inputs before a virtual sensor dates to self-validating inferential sensors [6]. No close isolator (leave-one-channel-out masking [2], PCA reconstruction-based validation [7, 8]) or repair-type defense is run, and CATCH [9] keeps its RevIN layer [10], which by construction hides constant-bias and stuck-at faults (Table 12: near-Naive on both) — the very property the authors invoke to remove RevIN from ITX.
- The "best-ranked robustification" claim is confounded: the ITX gate feeds a dropout-trained ModernTCN whereas MuViS-C hardens only a TST backbone [11]; about 40% of ITX's geometric-mean edge over XGBoost and CatBoost (Table 2) comes from HR, where an undefended ModernTCN already matches it (mPC 5.27 vs 5.30); and rPC rewards the gated system's inflated clean error (HR clean RMSE 3.53 vs ≈2.41 for the undefended ModernTCN). What remains is modest and not significant: against the best existing model per dataset, ITX wins clearly only on Vehicle (−27% mPC) and MMR (≈−13%), so its lead reflects consistency rather than large gains, and it is Nemenyi-significant only over bottom-ranked models, with PM10 and PM2.5 (identical detector results, implying shared inputs) counted as separate datasets and a mean-rank test whose outcomes depend on the pool [12].
- The evidence for ITX's design and generality is thin: all results come from a single training seed; the cumulative single-seed ablation on three dataset subsets attributes most of the recall gain to per-channel embeddings/heads and gives mixed support for substitution (no precision/recall gain over plain reconstruction on Vehicle; lower REVS precision than zero-masking); and the SMD check uses one machine with test-label thresholds where ITX trails ALoRa on 4 of 6 localization metrics. The evaluation also departs from deployment: test-time operating points are unmatched (Table 1 implies ≈0% healthy-channel false positives on Battery for 3σ/CATCH/CrossAD versus ≈9% for ITX), and every evaluated window contains exactly one fault, so the clean-data cost of gating is never weighed against realistic fault prevalence (on PM2.5, gating adds 3.3% clean RMSE in Table 13 for only a 3.5% mPC reduction in Table 2).
References
- [3] J. Yoon, Y. Zhang, J. Jordon, and M. van der Schaar. VIME: Extending the Success of Self- and Semi-supervised Learning to Tabular Domain. NeurIPS 2020.
- [4] D. Bahri, H. Jiang, Y. Tay, and D. Metzler. SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption. ICLR 2022.
- [5] A. Deng and B. Hooi. Graph Neural Network-Based Anomaly Detection in Multivariate Time Series. AAAI 2021, 35(5):4027–4035.
- [6] S. J. Qin, H. Yue, and R. Dunia. Self-Validating Inferential Sensors with Application to Air Emission Monitoring. Industrial & Engineering Chemistry Research, 36(5):1675–1685, 1997.
- [7] R. Dunia, S. J. Qin, T. F. Edgar, and T. J. McAvoy. Identification of Faulty Sensors Using Principal Component Analysis. AIChE Journal, 42(10):2797–2812, 1996.
- [8] C. F. Alcala and S. J. Qin. Reconstruction-Based Contribution for Process Monitoring. Automatica, 45(7):1593–1600, 2009.
- [9] X. Wu et al. CATCH: Channel-Aware Multivariate Time Series Anomaly Detection via Frequency Patching. ICLR 2025.
- [10] T. Kim, J. Kim, Y. Tae, C. Park, J.-H. Choi, and J. Choo. Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift. ICLR 2022.
- [11] J. U. Brandt et al. Reliable Virtual Sensing: A Multi-Domain Benchmark for Robustness Under Sensor Failures. arXiv:2609.18396, 2026.
- [12] A. Benavoli, G. Corani, and F. Mangili. Should We Really Use Post-Hoc Tests Based on Mean-Ranks? JMLR, 17(5):1–10, 2016.
Questions for authors
- Can you add Fu & Yan's leave-one-channel-out model [2], PCA reconstruction-based isolation [7, 8], CATCH with RevIN disabled [9, 10], and a detect–isolate–repair arm that substitutes ITX's own reconstruction for flagged channels? If single-pass substitution does not outperform these, what does ITX contribute beyond inference speed?
- Can you compare DIA and model-side hardening on the same backbone (ModernTCN-PGD/-F2F, or the ITX gate in front of TST-ISensD [11]), report clean RMSE and MuViS-C's worst-case baseline-crossing severity for every system, and measure headroom against the best ungated model, given that the dropout-trained "Naive" is worse than a nominally trained ModernTCN on 7 of 9 datasets (Table 11)? Please also replace Nemenyi with Holm-corrected pairwise Wilcoxon tests on de-duplicated datasets [12].
- Please report means ± std over at least 3 seeds for Tables 1–3; a factorial ablation crossing corruption type (including VIME-style per-timestep resampling [3]), per-channel embedding, per-channel head, RevIN and K; realized false-alarm rates on clean and corrupted windows with threshold-free AUROC; prevalence-weighted RMSE including multi-sensor faults; and SMD results on all 28 machines with thresholds chosen without test labels. Please also correct Appendix N, which states that ITX is best on localization on 8 of 9 datasets at both lower severities, whereas Table 14 shows 7 of 9 at severity 0.25 (3σ leads on Battery, ALoRa-T on T66-14).
4 comments
W2 & Q2: We agree that the robustification claim needs controls for the backbone, the metric and the statistics, and we ran the requested comparisons.
Backbone confound. We compared DIA and model-side hardening on the same backbone in both directions: the ITX gate in front of MuViS-C's released TST-ISensD, and our gated ModernTCN against ModernTCN-PGD and ModernTCN-ISensD (full test sets). F2F is defined in MuViS-C as fault-aware pretraining of the TST encoder, so a ModernTCN version would be a new method rather than MuViS-C's. Datasets on which the ITX gate gives the lower mPC:
| backbone | ITX gate vs. | ITX gate better |
|---|---|---|
| TST | TST-ISensD alone | 9 / 9 |
| ModernTCN | ModernTCN-PGD | 7 / 9 |
| ModernTCN | ModernTCN-ISensD | 9 / 9 |
On TST, the gate closes on average as much of the naive–oracle gap as on ModernTCN, so its benefit is not tied to our backbone.
HR and rPC. Dropping HR leaves ITX's Table 2 GM essentially unchanged (1.007 → 1.008), with the next best model at 1.118, so the lead does not rest on HR. ITX's lead in Table 2 is measured in mPC, which does not depend on clean error; we make mPC the primary metric and report clean RMSE for every system (see also our reply to hmFR, W2 & Q2).
Worst case. We computed MuViS-C's baseline-crossing severity: the lowest severity at which any fault on any channel pushes the RMSE to or above that of the mean predictor. Number of datasets on which a system never crosses (full test sets):
| ITX gate | TST-F2F | xLSTM-M | other 7 MuViS-C models |
|---|---|---|---|
| 5 / 9 | 4 / 9 | 2 / 9 | 0 / 9 |
ITX is also the most robust system in the worst case, and where it crosses, it does so late. On the capped protocol of Table 2, the other gates never cross on at most 2 of 9 datasets, and in our new runs under the same protocol, the ITX gate lifts TST-ISensD from 0 to 6 of 9. We will add the same-backbone comparisons, crossing severities and headroom to the appendix.
Headroom and size of the gains. Against the best ungated ModernTCN per dataset, trained with or without dropout, ITX has lower mPC on 8 of 9 datasets (all but PM10). The reviewer rightly notes that ITX's margin is large on only some datasets. Its advantage is generality: in the full MuViS-C pool, ITX has the lowest mPC on 4 of 9 datasets and is within 5% of the best on all others, whereas every other model is at least 1.8 times worse than the best on some dataset. Since the domain and failure mode are rarely known when a defense is chosen, we consider this generality one of its main practical benefits.
Statistics. As suggested, we replace Nemenyi with pairwise tests of ITX against each of the 9 MuViS-C baselines on mPC: one-sided Wilcoxon signed-rank tests with Holm correction, and the Bayesian signed-rank test with a ±1% region of practical equivalence. PM10 and PM2.5 are two MuViS-C tasks with different targets that share their input channels (App. D). We therefore also test on de-duplicated datasets, counting PM10/PM2.5 once (N=8) or one value per domain (N=6):
| N=9 | N=8, de-duplicated | N=6, one per domain | |
|---|---|---|---|
| Holm-Wilcoxon, significant at .05 | 7 / 9 baselines | 5 / 9 | 0 / 9 |
| Bayesian signed-rank, min P(ITX better) | .96 | .97 | .95 |
With all nine datasets, only the two tree ensembles narrowly miss significance (adjusted p = .098). With fewer datasets, the Wilcoxon test quickly runs out of power: with N=8, four baselines narrowly miss (adjusted p = .078), and with N=6, even a win on every domain gives p = 1/64, above .05 after Holm over 9 tests. The Bayesian test has no such floor and gives ITX a probability of at least .95 of being practically better than every baseline. We will report both tests in the final manuscript.
W3 & Q3: Single seed. We retrained all models with seeds 43 and 44 (ALoRa so far on 8 of 9 datasets for detection and 6 of 9 downstream; 3σ is deterministic). mPC (mean ± std) of ITX and the best other gate:
| PM10 | PM2.5 | Batt. | HR | TEP | Veh. | MMR | T66-13 | T66-14 | |
|---|---|---|---|---|---|---|---|---|---|
| ITX | 101 ± 1 | 67.9 ± .6 | .022 ± .002 | 4.76 ± .02 | .0525 | 3.24 ± .02 | .136 ± .004 | .104 ± .002 | .109 ± .0001 |
| best other | 103 ± 1 | 69.7 ± .7 | .061 | 4.71 ± .14 | .0527 | 3.34 ± .02 | .183 ± .002 | .124 | .098 ± .001 |
| CATCH | ALoRa-Loc | 3σ | CATCH | ALoRa-T | ALoRa-T | ALoRa-T | 3σ | ALoRa-T |
The seed variation is small compared with the gaps, and the ranking matches the single-seed tables; only on HR do CATCH and ITX now tie within one std. We will add the results over all seeds to the appendix.
Ablation. We replaced the cumulative ablation by the requested factorial one: every combination of corruption (none, zero-masking, noise, VIME-style, swap) with shared or per-channel embedding and head, plus RevIN and the number of swapped channels, each with 3 seeds on the App. I datasets (PM10, Vehicle, T66-13). mPC relative to ITX for each change, GM over the three datasets:
| change to ITX | mPC vs. ITX |
|---|---|
| shared embedding / shared head / both | ×1.02 / ×1.05 / ×1.12 |
| no corruption / noise / zero-masking / VIME-style instead of swap | ×1.09 / ×1.05 / ×1.12 / ×1.11 |
| with RevIN | ×1.43 |
| 1 or C/2 instead of C/3 swapped channels | ×1.02 / ×1.00 |
Every change to the corruption or the architecture makes ITX worse on average, and ITX has the lowest mPC of all 20 combinations. Untying only one part comes closest and is marginally better on PM10 or Vehicle, but clearly worse on T66-13, where isolation is hardest. The number of swapped channels matters little. We will add the full ablation to the final manuscript.
SMD. We ran all 28 machines with a label-free threshold and retrained ALoRa per machine; the results are in our reply to akjz (W3 & Q2). ALoRa detects slightly better, while ITX localizes better on every metric, most clearly on IPS (27 of 28 machines).
W3 & Q3 (continued): Operating points. All gates are calibrated to 1% FPR on clean validation data. We now report the false-alarm rate realized on clean test windows and, separately, on the healthy channels of corrupted windows, plus the threshold-free AUROC (means over 9 datasets, severity 1):
| ITX | other gates | |
|---|---|---|
| false alarms, clean windows | 1.3% | 0.6–1.0% |
| false alarms, healthy channels of corrupted windows | 3.1% | ≤ 2.3% |
| AUROC | .91 | ≤ .80 |
ITX realizes slightly more false alarms, but leads clearly on AUROC, i.e. independently of the threshold. Matching the false-alarm rates does not change the ranking: at a 0.1% target, ITX raises fewer false alarms on clean windows than any other gate at 1% and still has the lowest GM mPC (reply to akjz, W4 & Q4). The Battery case the reviewer points out is real, but these alarms only occur when another channel is faulty, not on clean data, and ITX still has by far the lowest Battery mPC. We will add both false-alarm rates and AUROC to the appendix.
Prevalence and multi-sensor faults. We weighted clean and faulty windows by the share of faulty windows and computed the share above which gating lowers the expected RMSE. We compare against the same dropout-trained predictor without gate (the gate's own cost, as in the reviewer's PM2.5 example) and against the nominally trained, ungated ModernTCN (the full pipeline):
| break-even vs. | PM10 | PM2.5 | Batt. | HR | TEP | Veh. | MMR | T66-13 | T66-14 |
|---|---|---|---|---|---|---|---|---|---|
| same predictor, ungated | 24% | 44% | 0% | 4% | 6% | 2% | 5% | 1% | 1% |
| nominal predictor, ungated | never | 64% | 2% | 40% | 15% | 1% | 17% | 29% | 18% |
The gate itself pays off at a few percent of faulty windows on seven of nine datasets; only on PM10 and PM2.5, where faults barely affect the predictor, does its clean cost dominate, as the reviewer observed. Against the nominal predictor, most of the cost comes from dropout training (reply to hmFR, W2 & Q2), which is therefore the main lever when faults are rare. Beyond the expected error, our focus is reliability: even if faults are rare, a small, constant clean-data cost can be worth paying if the estimate stays usable when a sensor fails (see the worst-case analysis in W2 & Q2). For 2–3 simultaneous faults, see our reply to akjz (W1 & Q1).
Appendix N. Will be corrected (7/9 at severity 0.25). Thank you for spotting this.
Thank you again for this careful review. If anything remains unclear, we are happy to provide further details.
We sincerely thank the reviewer for this thorough and constructive review. It pointed us to literature we had missed and prompted important new experiments. Working through these comments has substantially improved the manuscript.
W1 & Q1: Uncited ingredients. Thank you for these pointers. Parts of this lineage are already in the paper: our substitution was inspired by AnomalyBERT (Jeong et al., 2023), the DIA framing follows the fault-diagnosis literature (Isermann, 2006; Blanke et al., 2015), repair is discussed as a defense family (Section 1), and Fu & Yan (2024) in Section 2. However, we missed important precedents and will add them to Sections 2 and 4:
Close isolators and CATCH without RevIN. We added the three requested isolators, each evaluated in front of the same dropout-trained ModernTCN under the protocol of Tables 1–2:
Detection at 1% FPR and severity 1, and mPC relative to ITX (GM), on the 8 datasets without TEP, whose downstream sweep was not run for the new isolators:
ITX outperforms every close isolator downstream on every dataset. Leave-one-out comes closest, but needs one forward pass per channel. On RevIN, the reviewer is right: without it, CATCH detects bias and stuck-at faults, but still remains well behind ITX. We will add this comparison to the appendix and state the RevIN link in Section 5.1.
Repair. We replaced each flagged channel by ITX's reconstruction, as in Fu & Yan (2024), either from the same pass or from a second pass on the healthy channels only, and fed the result to the dropout-trained or the nominally trained predictor. GM over 9 datasets, relative to masking:
Under faults, masking remains best, since the reconstruction partly carries the fault along. On clean data, repair in front of the nominal predictor helps, since false alarms are replaced by a reconstruction instead of zeros, which makes it an option when faults are rare. We will add this comparison to the appendix.
Beyond inference speed. Under faults, ITX outperforms all close isolators and the repair arm, so its advantage goes beyond speed. We are glad the reviewer values the benchmark-scale evaluation and will make it more prominent among our contributions. ITX's contribution lies in combining the ingredients for channel-level isolation, and the factorial ablation (W3 & Q3) shows that this combination matters.