- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
As I understand, the paper wants to propose a relatively simple approach to timeseries anomaly detection, "without requiring complex network architectures or manually designed prior biases". The approach involves a Transformer architecture (which is to me a relatively complex network architecture) and a manually designed loss function. The final claim is that "complex representation learning designs are not always necessary". The results show that on some timeseries problems, their approach can be on par or outperform other approaches.
Although I agree with the authors that complex models are not always needed, this claim is so general, that it does not teach me much. It would help me more if the paper would show what types of model bias or architecture is superfluous, and for what type of problems it may actually help. In the introduction you mention "we argue that complex network architectures or inductive biases designed to capture particular patterns may not be the key factors for improving the performance", but then it does not become clear what the key factors actually are.
Critical strengths
It is good that models are compare to sensible baselines. I agree that many proposed architectures/loss functions/biases may not fix/alleviate some identified problem.
Critical weaknesses
I don't see how this substantially adds to our scientific knowledge. We know that simple models often work well. This paper suggests a (not-so-simple) model and some loss function, applies it to some datasets and then shows that it outperforms all other models.
Questions for authors
You showed that your transformer often outperforms the other approaches. Is this because the considered datasets are relatively simple? It is mentioned somewhere that "Unlike image, which contain highly complex patterns such as edges, textures, and shadows, time series are usually more periodic and easier to characterize.". But if you would have considered video data (also some type of time series data) then this would be more complex, wouldn't it? So then the other appoaches may be more appropriate?
Another detail: what do I see in Table 1? The caption says AUC-ROC, R_AUC-ROC and VUS-ROC, but the table itself contains VUS-PR, F1 and R_F1.