- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces a post-hoc correction framework motivated by the observation that most existing approaches iteratively use the same weak learners. The authors argue that correction units should dynamically change during recursion steps to adapt to the new residual output space. In essence, they contrast traditional boosting which repeatedly corrects errors using a fixed pattern with an adaptive self-correction mechanism that changes the output family across recursion steps. To achieve this, at each recursion step, the method trains a ridge probe to predict the residual from the historical context, generates a corrected prediction, and performs Singular Value Decomposition (SVD) on it to identify candidate basis functions for the correction. A supplementary statistical test is then applied to these candidates to select a valid subset. Once the basis is chosen, the correction is applied. At test time, all bases are fixed, and corrections are executed using the units saved during training. Overall, the method shows improvements compared to the base forecasters and outperforms -adapters, another post-hoc correction baseline.
Critical strengths
(i) The idea of selecting different correction units during recursion is conceptually sound. (ii)The paper provides several thorough ablations on different components of the methodology.
Critical weaknesses
(i)The paper is dense and difficult to read, often introducing technical details without offering sufficient intuition. For instance, it lacks a clear justification for why Benjamini-Hochberg FDR control is chosen over alternative protocols. Furthermore, the text frequently assumes advanced notions without explanation, while simultaneously providing excessive detail for certain experiments, which can confuse the reader. (ii)The approach relies heavily on a validation set, which is critical for performance and for preventing overfitting. It remains unclear how the method behaves if the available validation data has already been used for hyperparameter selection or early stopping. Moreover, in practical applications, practitioners may only have a large training split without a dedicated validation set; the paper does not analyze the impact of taking out validation data for post-hoc correction. (iii)The method lacks comprehensive comparisons with alternative post-hoc correction techniques. Given that the core motivation is to move beyond fixed base learners, a direct comparison against standard boosting using various fixed families of learners should be included. Beyond boosting, several other post-hoc approaches exist in the time-series literature that deserve baseline comparisons.
Questions for authors
1- Why to use Benjamin-Hochberg FDR control instead of other protocols? It would be worthy to state every protocol that could be used for performing the candidate selection and explain this statistical test is the one chosen as well as ablations on alternatives one
2- There are several related works omitted in post hoc correction of time series (including to calibration approaches, context augmentation approaches, finetuning ones) as well as comparison with the proposed approach with these methods. How does the method compare with applying boosting with different correctors family ? See for example Post-Training in Time Series Foundation Models: A Unifying Framework
3- Can you discuss the choice of validation set, its critical impact, how to choose them when giving a big training set and what are the impact of using part of training for the validation which may make the training less efficient. What is the tradeoff. If we take more samples for validation the training is obviously of less quality ... ?
I appreciate the author's effort. Therefore, I am raising my score to 2. However, the following issues remain:
Recursive gains: In the vast majority of cases, these do not yield additional benefits. Actual gains remain concentrated within specific datasets and backbones—most notably, Electricity and Traffic. The effectiveness of RSI remains highly conditional.
Statistical evidence: The primary recursive experiments cover only 216 out of 252 runs, failing to provide complete coverage. Furthermore, the authors explicitly state that their conclusions apply only to a fixed benchmark panel, which is insufficient to support broader generalizations.
Baseline comparison: The comparison with Direct Ridge is limited to the ETTh1, Weather, and Electricity datasets, and is conducted solely under the H96 setting. Even on these datasets, it is not demonstrated that GateCorrect consistently outperforms Direct Ridge. Additionally, the comparison with Full δ-Adapter covers only 13 cells.
Computational cost: For DLinear/Electricity, the original backbone contains only 0.0186M parameters, whereas a single correction unit adds 79.45M parameters. This leads to a substantial increase in both the number of parameters and deployment costs—a concern that is particularly significant given that recursive gains are not universally observed.
Presentation and readability: I concur with reviewer u8AQ’s assessment regarding the paper’s readability: "Furthermore, the text frequently assumes advanced notions without explanation, while simultaneously providing excessive detail for certain experiments, which can confuse the reader." Some advanced concepts in the paper lack necessary intuitive explanations, while certain experimental details are overly verbose. Moreover, the organization of information in Figure 1 and Figure 3 lacks clarity.