- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper attempts to address the problems of inaccurate anomaly scores and the difficulty of threshold selection in unsupervised time-series anomaly detection. The authors propose PVBoost, which refines anomaly scores by combining estimated anomaly probabilities with variations in predictions across iterations and automatically selects a detection threshold to improve anomaly detection accuracy.
Critical strengths
- Proposes a unified framework for anomaly score refinement and threshold selection, rather than treating the two steps independently.
- Uses anomaly probabilities to identify meaningful score variations, reducing the influence of noise in normal regions.
- Leverages the temporal continuity of anomalies to help automatically determine detection thresholds, reducing the need for manual threshold setting.
Critical weaknesses
- When the true anomaly ratio is below 2%, its performance is poor, even worse than the simple 3σ method.
- The paper claims that scoring and threshold selection can reinforce each other, but in reality, the threshold does not improve scoring in reverse.
- The improvement of score refinement is unstable, and some cases actually see performance deterioration.
- The method relies on the continuous occurrence of anomalies, which can easily cause misjudgments on scattered anomalies and sustained normal fluctuations.
- About 77% of the detection performance gain comes from threshold adjustment, and it remains uncertain whether the complex scoring optimization process is necessary.
Questions for authors
- Why is PVBoost not as effective as the simple 3σ rule when the true anomaly ratio is less than 2%? How can this problem be addressed?
- Since threshold selection does not feed back into score refinement, why is it called joint optimization? Can you provide direct evidence?
- Why do only 47% of detector–time-series pairs show improvement after score optimization? Can you explain the reason for the performance degradation?
- Can PVBoost maintain good detection performance when anomalies occur sporadically or when normal data exhibits continuous fluctuations?
- Since about 77% of the F-score improvement over the 3σ baseline comes from threshold adjustment, is complex iterative score optimization really necessary? Can you demonstrate that its additional benefits justify the computational cost?