- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PRE, a plug-and-play model that estimates and corrects the residuals of a base model without any parameter updates at deployment, by using past inputs, forecasts, and residuals as in-context examples. PRE builds a forecast memory consisting of past (input, forecast) scenarios and their residuals. Based on the similarity between the current scenario and the past scenarios, it computes a weighted aggregation of past residual information to predict a per-step residual distribution, and then corrects the forecast error by adding the median of this distribution to the current forecast. PRE is trained only on residuals from AutoARIMA, AutoTheta, and DLinear, using a two-stage strategy: it is first trained on synthetic residuals, obtained by adding combinations of eight types of interpretable error components to real residuals, and then further trained on real residuals that exhibit more complex patterns. When applied to 10 TSFMs, PRE reduces MASE by 2.69–10.89% in the in-domain setting and by 1.88–8.52% in the zero-shot setting. PRE also outperforms existing supervised residual correction methods such as COSA, ORCA, and -Adapter, and yields further improvements when combined with them. Through ablation studies, the authors validate the effectiveness of the historical residual labels and of the two-stage training with synthetic residuals, and quantitatively report the performance and inference overhead with respect to the forecast memory size (K) and the forecast horizon (H).
Critical strengths
- S1: The paper reformulates post-hoc forecast correction for TSFMs as an in-context residual regression problem, presenting a novel approach that uses past (input, forecast, residual) triples as in-context examples. Unlike existing residual correction methods, which rely on supervised parameter updates during deployment, the proposed method performs task-specific correction through contextual inference alone, without any parameter updates at deployment. As a result, it requires neither hyperparameter tuning nor expertise in model training.
- S2: Since the proposed method uses only the inputs and outputs of the base model, it can be applied regardless of the base model's internal architecture. Although it is trained only on residuals from lightweight forecasters, it improves performance in both the in-domain and zero-shot settings across 10 TSFMs with diverse architectures, demonstrating generalization to both unseen models and unseen tasks.
- S3: The paper addresses the scarcity of real residual data required for large-scale ICL pretraining through residual synthesis. A model trained solely on synthetic residuals still achieves substantial gains, confirming that the synthetic error patterns transfer to real forecasting errors.
Critical weaknesses
- W1: The proposed model (approximately 10.7M parameters) is structurally much larger than the linear or small MLP-based adapters used as baselines, and it incurs both a pretraining cost and the cost of encoding K past scenarios for every forecast. However, no quantitative comparison with the online update cost of the baselines is provided, and Table 22 does not include the cost of generating base forecasts at past time steps, which is required to construct the memory (i.e., the cold-start cost). An end-to-end cost comparison with the baselines is needed to support the claim of "low deployment overhead."
- W2: The paper presents the cost of fine-tuning and the difficulty of hyperparameter selection as its main motivation, yet it provides no comparison with TSFM fine-tuning (full or PEFT) in terms of either performance or cost. It also lacks comparisons with simple baselines, such as adding the mean of recent residuals or the most recent residual, or other residual-based statistical correction methods. Further evidence is therefore needed to justify the necessity of a model with approximately 10.7M parameters.
- W3: The performance gains are limited to less than 0.5% in the Finance, Economics, Sales, and Healthcare domains, and performance even degrades on some datasets. To assess the practical value of the method, horizon-wise results and an analysis of the conditions under which the correction degrades performance are needed.
- W4: Although PRE is designed to learn the residual distribution via an NLL objective, the quality of the predicted distribution (e.g., CRPS, coverage, calibration) is not evaluated, and it is not verified whether distributional modeling offers any advantage over direct point-estimate regression.
- W5: The paper does not report results at the dataset × model level, which makes it difficult to verify the results in Tables 10 and 11. Moreover, all experiments are conducted with a single random seed, so the variability of the results cannot be assessed.
Questions for authors
- Q1: Could you provide the end-to-end cost comparison described in W1?
- Q2: Could you provide comparisons with TSFM fine-tuning and residual-based statistical correction methods, as described in W2?
- Q3: Could you provide results and an analysis for the cases where performance degrades, as described in W3?
- Q4: Could you provide an evaluation of the probabilistic forecasting performance described in W4, as well as results obtained using statistics other than the median (e.g., the mean)?
- Q5: Could you add the complete dataset × model results described in W5? In addition, could you report confidence intervals based on experiments with at least three random seeds?
6 comments
Response to Reviewer HNuV (Part 2/5)
W2 and Q2: Comparison with TSFM fine-tuning and statistical methods
We appreciate your valuable suggestions on TSFM fine-tuning and statistical residual correction. To address your concerns, we have conducted the following additional experiments.
Comparison with TSFM fine-tuning. Due to the limited time and the large number of models and tasks, it was impractical to design effective fine-tuning strategies for all 10 TSFMs across 85 tasks. We therefore select Chronos-2[1] and TimesFM-2.5[2] to finetune as their official implementations provide fine-tuning interfaces. We fine-tuned each model on 85 tasks using LoRA under their suggested fine-tuning settings. Furthermore, we applied the original, unmodified PRE to correct the forecasts of the fine-tuned base models.
| Method | In-domain MASE | In-domain Gain | Zero-shot MASE | Zero-shot Gain |
|---|---|---|---|---|
| Chronos-2 | 0.914 | -- | 0.886 | -- |
| Chronos-2+PRE | 0.840 | +8.06% | 0.835 | +5.76% |
| Chronos-2 LoRA | 0.869 | +4.91% | 0.857 | +3.35% |
| Chronos-2 LoRA+PRE | 0.820 | +10.25% | 0.816 | +8.00% |
| TimesFM-2.5 | 0.853 | -- | 0.834 | -- |
| TimesFM-2.5+PRE | 0.830 | +2.69% | 0.818 | +1.88% |
| TimesFM-2.5 LoRA | 0.832 | +2.37% | 0.795 | +4.65% |
| TimesFM-2.5 LoRA+PRE | 0.819 | +3.89% | 0.788 | +5.51% |
Results show that compared with fine-tuning alone, applying PRE to the original base models achieves better or comparable performance. More importantly, even after fine-tuning on specific tasks, the original, unmodified PRE can still provide further performance improvements: PRE reduces MASE by 5.64% and 4.78% on fine-tuned Chronos-2, and by 1.56% and 0.88% on fine-tuned TimesFM-2.5. These results highlight an important advantage of PRE as we discussed in Section 1: PRE provides effective plug-and-play correction without requiring users to understand the internal architectures of base models to conduct task-specific tuning. In contrast, fine-tuning requires additional model- and task-specific experimentation, and frequently updating large TSFMs online is computationally demanding.
Comparison with Statistical Methods. We evaluate four training-free statistical correction methods, including using the most recent residual (i.e., a zero-order hold), averaging historical residuals, and KNN. For KNN, we use the same memory size as PRE () and evaluated two strategies: using the most similar residual and weighted averaging the similarity of residuals.
| Method | In-domain MASE | In-domain Gain | Zero-shot MASE | Zero-shot Gain |
|---|---|---|---|---|
| Base TSFM | 0.915 | -- | 0.901 | -- |
| Last Residual | 1.246 | −36.17% | 1.189 | −31.84% |
| Mean Residual (K=16) | 0.966 | −5.63% | 0.945 | −4.80% |
| Nearest-neighbor Residual | 1.150 | −25.72% | 1.114 | −23.67% |
| KNN weighted (K=16) | 0.943 | −3.12% | 0.919 | −1.93% |
| PRE | 0.860 | +5.99% | 0.859 | +4.71% |
The results show that these statistical methods fail to improve forecasting performance. For a well-specified forecasting model, the remaining residuals are expected to behave approximately as white noise, with little systematic structure left to exploit[3]. Our experimental analysis also reveals that, for strong base forecasters, useful patterns in the residuals are often obscured by noise. Consequently, directly aggregating raw residuals makes it difficult to identify beneficial correction structure. Considering the ability of deep learning models to suppress noise and extract informative patterns, as well as the preliminary success of existing studies in forecast correction (as discussed in Section 2.2), we further sought a generalizable mode to perform inference without task-specific training. These considerations motivated our choice of a pretrained model as the backbone of PRE. These additional experiments, together with the existing results in Section 4.2, demonstrate the effectiveness of using a pretrained model to perform residual inference through in-context learning.
We sincerely appreciate your suggestion for additional comparisons, which has helped us further demonstrate the value of our work. We will also incorporate comparisons with fine-tuning methods and their combinations with PRE into the revised manuscript. We hope these additional experiments and analyses fully address your concerns.
[1] Ansari, Abdul Fatir, et al. “Chronos-2: From Univariate to Universal Forecasting.” arXiv preprint arXiv:2510.15821 (2025).
[2] Das, Abhimanyu, et al. “A Decoder-Only Foundation Model for Time-Series Forecasting.” Proceedings of the 41st International Conference on Machine Learning (2024).
[3] Hyndman, Rob J., and George Athanasopoulos. Forecasting: Principles and Practice. 3rd ed. OTexts (2021).
Response to Reviewer HNuV (Part 3/5)
W3 and Q3: Analysis of applicability
Thank you for your thoughtful comments on the domain-wise performance of PRE. We appreciate the opportunity to further clarify the factors that may influence its effectiveness across different forecasting domains. Although we have discussed this issue in Section 4.4 and outlined related future research directions in Section 5, we provide a more detailed analysis using specific datasets to better explain the current applicability of PRE.
The effectiveness of historical residual correction depends on how well the underlying system dynamics can be inferred from the observed forecasting context. The future evolution of a dynamic system may be governed by its internal dynamics, as reflected in its historical states, or substantially influenced by external factors beyond the observed time series [4]. In the former case, historical observations can provide key information for inferring future changes. In the latter, if such external factors are not recorded, historical observations alone are insufficient to explain future system evolution, thereby weakening the transferability of historical scenario–residual relationships.
Examples in our experiments. As discussed in Section 4.4, datasets in Finance, Healthcare and Sales are substantially subject to external factors such as public policies, human behavior, and market interventions [5] [6]. Specifically, we further examined all four datasets on which PRE fails to achieve positive correction gains and found that their forecasting targets are influenced by broader external economic and social factors that are not captured by the available observations:
| Dataset | Recorded Data | Important External Factors |
|---|---|---|
| Port Activity | International cargo flows | Global trade demand, port operations |
| Crypto | Cryptocurrency prices | Investor sentiment, regulatory policies |
| Uncertainty 1M | Economic uncertainty indices | Monetary and fiscal policies, macroeconomic indicators |
| epf electricity price | Electricity prices | Electricity demand, fuel costs, generation capacity |
This analysis is consistent with the motivation behind PRE's architecture design: its effectiveness depends on whether historical forecasting scenarios contain sufficient information to explain residual variations. This also motivates a promising future direction discussed in Section 5: incorporating exogenous covariates that influence future system evolution into the forecast memory, with the aim of improving forecasting performance on tasks that are strongly affected by external factors.
[4] Cheng, Changqing, et al. “Time Series Forecasting for Nonlinear and Non-stationary Processes: A Review and Comparative Study.” IIE Transactions 47, no. 10 (2015): 1053–1071.
[5] Stock, James H., and Mark W. Watson. “Macroeconomic Forecasting Using Diffusion Indexes.” Journal of Business & Economic Statistics 20, no. 2 (2002): 147–162.
[6] Kraemer, Moritz U. G., et al. “The Effect of Human Mobility and Control Measures on the COVID-19 Epidemic in China.” Science 368, no. 6490 (2020): 493–497.
Response to Reviewer HNuV (Part 1/5)
We sincerely appreciate your thoughtful and constructive review, and are particularly grateful for your recognition of PRE's core idea of formulating post-hoc forecast correction as an in-context residual regression problem.
We have carefully considered all your concerns regarding the sufficiency of our experimental results and conducted extensive additional experiments to address them. Specifically, we have added a deployment cost comparison with existing online adaptation methods (W1, Section 4.7 and Appendix D.6), comparisons with TSFM fine-tuning and training-free statistical correction methods (W2), and further analyses of domain-dependent correction performance (W3, Section 4.4). We have also evaluated the probabilistic forecasting quality of PRE and compared distributional residual estimation with direct point-estimate regression (W4, Appendix D). Furthermore, we have provided complete dataset-level results for all 10 TSFMs and conducted additional experiments with three random seeds (W5). These additional experiments provide further evidence of PRE's effectiveness, deployment efficiency, probabilistic modeling capability.
W1 and Q1: Discussion on deployment cost
Thank you for pointing out the potential additional cold-start costs during deployment. To address your concerns, we would first like to clarify that users do not need to train PRE during deployment, and its forecast memory Mt only maintains the most recent K forecasting records, as detailed in Section 4.1. Therefore, the cold-start cost only involves generating K forecasts using the base forecaster.
Cold-start cost. To further address your concern, we report the time required by statistical forecasters and foundation models to construct K=16 historical forecasting records used in our main experiments, with context length L=512 and forecast horizons H∈24,48,96.
As shown above, the cold-start cost for foundation models remains below 50ms, which is generally negligible. Even the slowest statistical forecaster, ARIMA, requires only 5.0 seconds to generate 16 forecasts with L=512,H=96. Moreover, this cost is incurred only once at the beginning of a task. During deployment, Mt is maintained in a first-in-first-out (FIFO) manner, without reconstructing the entire memory for each forecast. We have further clarified the online memory update procedure in Section 4.1 to avoid potential confusion.
Online cost compared with baselines. Following your suggestion, in addition to the PRE deployment cost already reported in Figure 3 of Section 4.7 and Table 24 of Appendix D.6, we further compare PRE with the three online adaptation baselines under the same hardware conditions (as detailed in Appendix B.5) at H=96. The results are reported below:
The results show that although online adapters have low inference costs, they require additional repeated computation for parameter updating during deployment. In contrast, our PRE shifts this computation to offline pretraining. Therefore, PRE achieves a comparable overall deployment cost and delivers substantially better performance with much larger model capacity. Overall, these results further support the effectiveness and low deployment cost of PRE. We hope these clarifications and additional results address your concerns, and sincerely thank you again for your constructive suggestions.