- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper frames multivariate time series anomaly detection as detecting a system's deviation from its stable state, and then leverages critical-transition theory to solve the transformed task. The high-level idea is to forecast each step in both slow and fast paths, and then put the residual into Kalman filters, and finally produce the final score. The experiments is done on 17 multivariate datasets and show that such a simple method has shown competittive edge over diverse baselines.
Critical strengths
- Bringing the dynamical system theory into the multivariate time series anomaly detection is a notable contribution, bridging two fields altogether and allowing for principled anomaly detection.
- The method is evaluated on a large standardized benchmark with the official baseline. Faithful and trustworthy.
- The method is lightweight, with code released.
Critical weaknesses
- The positioning of the paper is unclear, which directly influences the evaluation of the paper. From each aspect:
- As a theoretical contribution, it is thin, as though the paper presents its method in critical-transition theory but contains no theoretical analysis that is
specificto anomaly detection & time series analysis. Nothing is derived about what had to be changed or adjusted for this specific application (Appendix D is just a standard Kalman filter property). A direct cross-domain adaptation does not show substantial novelty or investigation in this interdisciplinary context. - As a methodological contribution, the architecture is from very well-established components, such as slow and fast parts, the normalized Kalman, etc.
- The averaged results hide what happened to individual datasets, which makes the method look stronger than it is. In reality, we seldom seek a generalist that can solve all the problems. For example, excluding datasets like TAO can substantially change the ranking. The sensitivity to the dataset shall be analyzed, and how the method can be adapted to each scenarios shall be explored to make the method indeed useful.
Questions for authors
Please see the weaknesses above.