- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies test-time adaptation (TTA) for streaming time-series anomaly detection under a deliberately coarse feedback protocol, after a contiguous interval of detection units has been fully scored, an external provider returns one binary bit. A negative bit certifies every timestamp in the interval as normal; a positive bit asserts only that at least one anomaly occurred somewhere in the interval, with no localization. Committed scores are immutable, and feedback can only affect future detection units.
Critical strengths
- The related works have been conducted in a thorough manner.
- The details of the experiment are also quite clear.
Critical weaknesses
- The method itself is a bit too simplistic and only takes up less than one page.
- M2N2 and CANDI receive no external feedback, and BALAD uses point-specific endpoint feedback under a different protocol. The authors acknowledge this ("Comparisons are therefore not uniformly matched"), but the main table still juxtaposes these methods as if FITTA's gains are comparable. A fairer comparison is needed.
- The visualization in this paper is seriously lacking.
- Continuous feedback throughout every period of time is also unrealistic. Could there be some moments when no feedback is needed? For instance, a long-term stable state.
Questions for authors
Please see Weaknesses.
2 comments
The response did not address my concerns, and I notice that other reviewers have also raised many difficult questions that couldn't be easily resolved. Therefore, I will keep my rating.
We thank the reviewer for the constructive comments and have revised the manuscript accordingly.
W1. Method simplicity. Our central question is whether coarse existential feedback can support future-only adaptation without revealing anomaly locations. FITTA is a minimal implementation of this information constraint, with contributions in the chronological feedback setting and its empirical characterization (Secs. 3–5).
W2. Baseline fairness. We agree that cross-protocol results should not imply equal-supervision algorithmic superiority. Revised Table 1 focuses on Frozen versus FITTA, while M2N2, CANDI, and BALAD are retained as contextual comparisons in Appendix B (Table 7). Controlled evidence is provided by the component ablations (Table 2), localization oracles (Table 4), and matched-response scheduling comparisons (Table 5).
W3. Visualization. We added a seven-family TPR/FPR analysis (Figure 2, Sec. 5.3) and a temporal case study (Figure 3, Appendix G).
W4. Continuous feedback. Our protocol requests one response per completed interval, not continuous pointwise labels. FITTA adjusts the next interval's resolution; deciding when to skip feedback is a separate acquisition problem. We clarify this distinction in Sec. 6.