- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper proposes QPath a method to evaluate how different a quantile forecast is from the ground truth. QPath uses the Rayleigh quotient of the median residuals and its precision matrix to score how anomalous a quantile forecast is. The authors provide many experiments and ablations on the TSB-AD dataset with Chronos 2 and TimesFM time series foundation models. The results show that QPath performs better than the quantile error for anomaly detection. The paper also looks at some ablations of QPath, including only using the diagonal entries of the precision and using Mahalanobis distance instead of QPath.
Critical strengths
-
Figure 3 is nice and shows both what the task is and the behaviour of QPath
-
The authors provided statistical testing for some of their results, even though it is unsurprising given the sample size of significance.
Critical weaknesses
-
The paper is quite hard to read. Many paragraphs do not contain a starting/topic sentence and many non sequiturs. This needs to be fixed for me to adjust my score.
-
The paper does not state that QPath is the Rayleigh quotient of the median residuals and its precision matrix. Nor that Rayleigh quotients have been extensively used in ML, including for anomaly detection. This significantly limits the novelty of the paper and reference to the Rayleigh quotient and its use in ML should be given.
-
The paper does not compare to existing anomaly detection methods not calibration-based methods, only to quantile error in the main results. Therefore, it is hard to understand the performance of QPath with respect to existing work.
-
As a minor point, I think how VUS-PR works should be explained in the text somewhere, maybe the appendix.
Questions for authors
- Why for variance burst does the QPath perform better? As I would naively think that the residuals would not be correlated in this case.
4 comments
This comment continues our response (2/2).
W3. Comparison with existing methods in the main results
"The paper does not compare to existing anomaly detection methods not calibration-based methods, only to quantile error..."
Following the reviewer's suggestion, we have added to the main results a calibration-based method, W1-ACAS (Martinez Gil et al., ICLR 2026), and an existing detection score, the error-vector Gaussian (Malhotra et al., 2015). Both compute an anomaly score from the errors of the same quantile forecasts, as quantile error does. W1-ACAS calibrates the forecast errors and keeps adapting while it scores, and the error-vector Gaussian fits a Gaussian to the errors of the median forecast.
Table R2. VUS-PR on U, Full / Test (series and timestamps common to all four rules).
| Model | Forecast | Quantile error | W1-ACAS [1] | Error-vector Gaussian [2] | QPath |
|---|---|---|---|---|---|
| Chronos-2 | ZS | 0.311 / 0.324 | 0.203 / 0.263 | 0.341 / 0.358 | 0.383 / 0.397 |
| FT | 0.319 / 0.332 | 0.203 / 0.262 | 0.343 / 0.359 | 0.389 / 0.402 | |
| TimesFM 2.5 | ZS | 0.316 / 0.330 | 0.211 / 0.268 | 0.375 / 0.391 | 0.389 / 0.401 |
| FT | 0.320 / 0.333 | 0.210 / 0.267 | 0.376 / 0.393 | 0.395 / 0.407 |
QPath is the highest in all eight settings of Table R2. Among the compared rules, it is the only one that uses how the errors at consecutive time steps of one forecast relate to each other. Among the published forecasting-based detectors of the TSB-AD leaderboard, QPath is also first, with 0.407 on U and 0.371 on M against 0.343 and 0.313. Details are in Sections 5.2 and 5.4 and Appendix H.1.
W4. Explanation of VUS-PR
"...how VUS-PR works should be explained in the text somewhere, maybe the appendix."
Following the reviewer's suggestion, Section 4.2 now explains VUS-PR with its formula. In short, each labeled anomaly range is extended by a buffer of ℓ time steps, the area under the precision–recall curve is computed for every ℓ from 0 to a window w, and VUS-PR is the average of these areas. It is therefore threshold-free and tolerant of a small time lag. Details are in Appendix B.4.
Q1. Why QPath improves variance bursts
"Why for variance burst does the QPath perform better? As I would naively think that the residuals would not be correlated in this case."
We appreciate this thoughtful question. QPath does not require the residuals of an anomaly to be correlated. It uses the correlation of normal residuals as a yardstick and raises a path whose arrangement is unusual under that correlation.
In our synthetic data, a variance burst amplifies the noise of the series, which is autocorrelated (AR(1) with coefficient 0.8), so the residuals inside a burst remain correlated as normal residuals are, and the direction factor does not single them out. From the definition of the score, the gain arises in two other places. First, at the start of a burst, a path that is calm and then abruptly large is a rare arrangement when neighboring residuals are positively correlated, so the direction factor raises it, as for a spike. Quantile error averages over the 64 steps of the path, so it is still small at this point. Second, the largest normal errors come from residuals that drift to one side, a common arrangement that the direction factor lowers, so fewer normal paths rank above the burst. We have added this analysis to Section 5.1.
We thank the reviewer again for the constructive comments, which have helped us improve the paper.
References
[1] Natalia Martinez Gil, Fearghal O'Donncha, Wesley M. Gifford, Nianjun Zhou, Dhaval C. Patel, and Roman Vaculin. Adaptive Conformal Anomaly Detection with Time Series Foundation Models for Signal Monitoring. ICLR 2026.
[2] Pankaj Malhotra, Lovekesh Vig, Gautam Shroff, and Puneet Agarwal. Long Short Term Memory Networks for Anomaly Detection in Time Series. ESANN 2015, pp. 89–94.
Reply to rebuttal
Dear Authors,
Thank you for your rebuttal that addressed many of my concerns. Given this I will increase my score and think the paper is much improved.
Thank you for your kind reply and positive assessment of our revision. Your feedback has greatly improved the paper.
If you have any remaining concerns, please let us know and we will do our best to address them.
General response
We sincerely thank the reviewer for the careful review and constructive feedback, and we apologize for posting our response late in the discussion period. We appreciate the positive remarks on Figure 3 (S1) and the statistical testing (S2). In this response and the revision, we address the readability of the text (W1), the Rayleigh quotient (W2), the comparison with existing methods (W3), the explanation of VUS-PR (W4), and the gain on variance bursts (Q1). Section and table numbers refer to the revised paper.
W1. Readability of the text
We sincerely apologize that the original manuscript was hard to read. In the revision, we (i) rewrote the main text so that every paragraph opens with the statement it develops, (ii) removed the non sequiturs by stating the reason that links each claim to the next and by removing the caveats that interrupted the argument, (iii) defined each term at first use, and (iv) reorganized the text, so that Section 3 opens with an overview and builds the score step by step with Figure 1, and the abstract and introduction are rewritten. For example, Sections 5.2 and 5.3 now open with their main result, Section 5.5 opens with what the two ablations test, and Section 5.1 now gives the reason why QPath helps on abrupt anomalies and not on trend changes.
W2. Naming the direction factor as a Rayleigh quotient
We thank the reviewer for pointing this out, and we apologize for not stating it. The squared direction factor of QPath is the Rayleigh quotient ρ(v)² = vᵀPv / vᵀv, where v holds the standardized residuals of a path and P is the inverse of the regularized covariance matrix of such residuals in the reference. The revision now states this (Sections 1, 2, and 3.3) and cites the statistical background of the quotient in Section 2, namely matrix analysis (Horn & Johnson, 2012), PCA, Fisher discriminant analysis, and the Mahalanobis distance, which is a standard score for anomaly and out-of-distribution detection (Lee et al., 2018).
The quotient itself is well known, and we exploit two of its properties. It depends only on the direction of v, not on the size of the error, and it is small for arrangements along which normal residuals vary together and large for arrangements that are rare. What is new is its use to model how the errors at different time steps relate to each other, which a quantile forecast, made for each time step separately, does not provide. The size of the error is measured by the quantile loss of the forecast, in place of the length of v that the Mahalanobis distance uses. In the tables, Full denotes evaluation on the whole series, as in the TSB-AD protocol, and Test on its test part alone.
Table R1. Full VUS-PR on U. "Diagonal of P only" removes the entries of P that couple different time steps.
As shown in Table R1, the gain disappears when the entries of P that couple different time steps are removed, so it comes from the relation between time steps. QPath also exceeds the Mahalanobis form, which applies the same quotient to the length of v, in all 16 settings (U and M, two forecasting models, ZS and FT, Full and Test) with p ≤ 0.011. Details are in Section 5.5 and Appendix H.2.