- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether target-specific encoder learning is necessary when historical observations are available as empirical references. FARO uses a fixed, randomly initialized time–frequency encoder, stores channel-specific features of historical observations, and scores each query based on its distance to nearby references. The same channel-level deviations are used for anomaly detection and localization. Experiments show that FARO is competitive and that the evaluated encoder-training procedures do not consistently improve mean performance.
Critical strengths
- Practical performance: Table 1 and Appendix C report strong detection performance across both benchmark tracks using ten independently initialized FARO encoders. The comparisons include learned, pretrained, and random-feature detectors rather than only a weak baseline.
- Interesting findings on the role of the encoder: The finding that a fixed, randomly initialized encoder can perform competitively is interesting because it challenges the common expectation that encoder learning is necessary for anomaly detection.
Critical weaknesses
- Dependence on historical data: TSFMs can be useful when only limited target-specific training data are available, and few-shot learning can sometimes provide satisfactory results. Since FARO directly relies on historical data for its reference set, its performance may deteriorate when these data are limited.
- Generality of encoder comparisons: The TSFM comparisons in Table 1 evaluate complete detectors rather than pretrained representations under the same reference-scoring procedure. The referee would like to see controlled comparisons across representative encoder architectures, including randomly initialized, frozen pretrained, and fine-tuned variants.
Questions for authors
- How does FARO perform when only a limited amount of historical data is available? Can the authors evaluate progressively shorter training prefixes, construct references using only each prefix, and keep the test segment fixed? Comparing FARO with pretrained TSFMs under the same target-history budgets would clarify how much historical data FARO needs to remain competitive.
- Can the authors extend the encoder comparisons to representative architectures, including TSFMs? For each suitable backbone, please compare randomly initialized and frozen, pretrained and frozen, and pretrained and fine-tuned variants, using the same feature readout, reference data, and scoring procedure.
4 comments
Official Comment by Authors
Q2. Generality of Encoder Comparisons
“For each suitable backbone, please compare randomly initialized and frozen, pretrained and frozen, and pretrained and fine-tuned variants, using the same feature readout, reference data, and scoring procedure.”
Pretraining improves detection across all evaluated backbones, whereas additional fine-tuning provides no consistent gain once historical references are available.
We evaluated TSPulse, MOMENT, TimesFM, and Chronos under three conditions: Random Frozen, Pretrained Frozen, and Fine-tuned. Within each backbone, we kept the feature readout, reference/query windows, normalization, reference bank, and cosine 3-NN scoring identical across conditions. This directly separates the contribution of pretraining from that of subsequent fine-tuning. The experiment covers the complete TSB-AD-U/M benchmarks (350 U and 180 M series).
Table 2(a). Controlled encoder comparison on TSB-AD-U (VUS-PR ↑)
| Backbone | Random Frozen | Pretrained Frozen | Fine-tuned |
|---|---|---|---|
| TSPulse | 0.1838 | 0.3150 | 0.3144 |
| MOMENT | 0.2647 | 0.3894 | 0.3728 |
| TimesFM | 0.2074 | 0.2566 | 0.2552 |
| Chronos | 0.2492 | 0.3698 | 0.3675 |
Table 2(b). Controlled encoder comparison on TSB-AD-M (VUS-PR ↑)
| Backbone | Random Frozen | Pretrained Frozen | Fine-tuned |
|---|---|---|---|
| TSPulse | 0.1979 | 0.3472 | 0.3419 |
| MOMENT | 0.2879 | 0.3339 | 0.3328 |
| TimesFM | 0.2004 | 0.2494 | 0.2493 |
| Chronos | 0.2427 | 0.3261 | 0.3276 |
First, Pretrained Frozen outperforms Random Frozen in all eight backbone–track comparisons, demonstrating the value of pretrained representations for reference-based anomaly detection.
Second, fine-tuning reduces mean VUS-PR in seven of eight comparisons; the only improvement is +0.0015 for Chronos on M.
These results distinguish the benefit of pretraining from the additional benefit of fine-tuning. Even when pretrained representations improve detection, further fine-tuning does not consistently help when historical observations are retained as references. This strengthens our central argument that the incremental value of encoder learning should be examined relative to the evidence already available in historical references.
We thank Reviewer NnAG for suggesting these valuable experiments. We will incorporate the main results into the revised manuscript and provide detailed experimental settings and additional analyses in the Appendix.
Thank you for the additional experiments, which substantially address my concerns about limited historical data and encoder generality. The results support the value of pretraining while showing no consistent additional benefit from target-specific fine-tuning under the tested settings. Please make this distinction explicit in the manuscript’s main claims and include the absolute history lengths and key experimental details in the revision. I maintain my weak acceptance recommendation.
Official Comment by Authors
Thank you very much for your thoughtful feedback and encouraging assessment.
In response to your suggestion, we have added the absolute history lengths and clarified the history-budget definition in Appendix H.2.
We sincerely appreciate your careful evaluation and constructive suggestions.
Official Comment by Authors
We sincerely thank the reviewer for their thoughtful feedback. To address the two questions raised, we conducted additional experiments and present the results below.
Q1. Limited Historical Data and Comparison with Pretrained TSFMs
FARO outperforms the compared fine-tuned TSFM detectors even with limited historical data, while benefiting from additional history.
We evaluated FARO and four pretrained TSFMs (TSPulse, MOMENT, TimesFM, and Chronos) with 5%, 10%, 25%, 50%, 75%, and 100% of the training history. At each budget, FARO constructs its reference bank using only the available training prefix, and each TSFM is fine-tuned using that same prefix. The test segment is fixed across all methods and budgets.
Since repeatedly fine-tuning four TSFMs across six history budgets incurs substantial computational cost, we used a fixed, performance-independent stratified subset of 50 series (32 U, 18 M), covering 17 U and 14 M dataset families. Selection accounted for sequence length and channel count, and every method was evaluated on the same series.
Table 1(a). Limited-history detection on TSB-AD-U (VUS-PR ↑)
Table 1(b). Limited-history detection on TSB-AD-M (VUS-PR ↑)
FARO achieves the highest mean VUS-PR at every history budget on both tracks. With only 5% history, FARO reaches 0.4469 (U) and 0.3258 (M). On U, 25% history already achieves nearly the full-history performance (0.5417 vs. 0.5420). On M, performance rises from 0.3258 to 0.4101 as history increases from 5% to 100%.
These results show that FARO does not rely on extensive historical data to achieve strong anomaly detection, remaining effective even with limited history. Moreover, retaining more historical observations as references can further improve detection performance.