- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Dynamic Memory-enhanced Residual Correction (DMRC), an external adaptation framework for frozen time-series forecasters. Offline, it constructs hierarchical residual prototypes using a learned residual-aware representation and decomposes their values into principal-subspace and orthogonal components. During deployment, fixed gates combine retrieved residuals with the base forecast, while label-free consistency signals and leave-one-out prototype credit update channel-wise retrieval priorities through KL-regularized mirror descent. The forecaster and memory contents remain frozen. The main contributions are residual-aware hierarchical retrieval and online adaptation of residual selection without future labels.
Critical strengths
Practical adaptation setting. DMRC adapts frozen forecasters without online parameter optimization or future labels, making it relevant when retraining and immediate supervision are unavailable.
Broad empirical coverage. Across seven datasets, six forecasters, and four horizons, DMRC improves MSE in 146 of 168 settings. This breadth supports the practical usefulness of residual correction across different forecasting architectures.
Critical weaknesses
The external baseline comparisons are difficult to verify. Appendix D.1 describes TQNet as retrieving historical segments and their futures, whereas the cited method uses learnable temporal queries within attention. How it was adapted to the shared frozen-checkpoint setting is unspecified, undermining confidence in the comparative evaluation.
The proposed uncertainty feedback appears ineffective for Chronos. Its interval-width term is unchanged when a residual prototype is removed, so it cancels in the leave-one-out credit (Eqs. 15 and 21). As written, only temporal-overlap feedback can drive updates. Without a Chronos-specific static-versus-dynamic ablation, the reported gains do not establish the contribution of the proposed online adaptation mechanism.
Questions for authors
Clarification: How were TQNet and KUP-BI implemented under the shared frozen-checkpoint protocol? What modifications were made, and which additional parameters were trained?
Clarification: For Chronos, how can removing a residual prototype change the interval-width term in Eq. 15? Does this term contribute any nonzero leave-one-out credit?
Evidence needed for assessment: Can you provide Chronos results comparing static residual memory, overlap-only updates, and full DMRC under identical settings? This would establish whether its gains depend on the proposed online adaptation.
3 comments
Response to Reviewer HvMV (Part 2/2)
W2 and Q2 (continued): Clarification of the Update Term
To remove this ambiguity, we now explicitly identify the raw interval width as a diagnostic quantity only and no longer describe it as part of the leave-one-out update. We have also corrected Eq. 15 to reflect the term used in the implementation, namely the corrected quantile-view dispersion.
W2 and Q3: Static and Dynamic Residual Memory for Chronos
Following the reviewer's suggestion, we conducted a strictly controlled comparison among Static residual memory, Overlap-only updates, and Full DMRC. We report three-seed results on ETTm1 at .
| Seed | Static MSE / MAE | Overlap-only MSE / MAE | Full DMRC MSE / MAE | MSE Improvement of Full over Static |
|---|---|---|---|---|
| 2021 | 0.497988 / 0.444660 | 0.497988 / 0.444660 | 0.497890 / 0.444568 | +0.0197% |
| 2022 | 0.497955 / 0.444888 | 0.497955 / 0.444888 | 0.497613 / 0.444620 | +0.0686% |
| 2023 | 0.496658 / 0.444055 | 0.496658 / 0.444055 | 0.496606 / 0.444037 | +0.0103% |
| Mean over three seeds | 0.497533 / 0.444534 | 0.497533 / 0.444534 | 0.497370 / 0.444408 | +0.0329% |
Full DMRC achieves lower MSE than Static for all three seeds. The mean MSE decreases from 0.497533 to 0.497370, corresponding to an average improvement of 0.0329%; the mean MAE also decreases from 0.444534 to 0.444408, an improvement of 0.0284%. Under the same setting, the frozen Chronos model has an MSE of 0.510745. Static residual memory therefore already provides the main improvement of approximately 2.59%, while Full DMRC further increases the total improvement to approximately 2.62%. These results indicate that hierarchical residual memory itself provides the primary and more stable benefit, while online residual-selection adaptation can offer an additional improvement on top of the static correction.
Importantly, Overlap-only is numerically equivalent to Static for all three seeds, whereas Full DMRC further reduces MSE for every seed. Because the corrected-quantile view term is the only difference between the two dynamic variants, this controlled comparison attributes the additional improvement in this setting to the quantile-view feedback rather than to the temporal-overlap term or to differences in the base forecaster, memory contents, or gating parameters. Together with the nonzero leave-one-out credit diagnostic above, the results establish a complete evidence chain: the corrected-quantile view term produces nonzero prototype credit, changes online retrieval priorities, and yields a consistent accuracy improvement across seeds on ETTm1 at .
We also conducted extended diagnostics on other horizon--dataset combinations. The incremental benefit of online updating is setting-dependent and does not consistently exceed Static under all conditions. We have therefore narrowed our conclusion as follows: static hierarchical residual memory is the primary and more stable source of the Chronos gains, whereas label-free online residual-selection adaptation provides a small but reproducible additional benefit in some settings. This more precise conclusion both distinguishes the contributions of the two DMRC components and clarifies the applicability boundary of the current surrogate feedback.
Accordingly, we have corrected the definition of Eq. 15 and revised the Methods, ablation study, and Limitations sections to clarify the feedback term used in the implementation, add the controlled comparison among the three settings, and state the setting dependence of the online benefit.
We again thank the reviewer for helping us identify the ambiguity between the original equation and the implementation, and for motivating a controlled comparison that distinguishes the contribution of static residual memory from that of online adaptation.
Response to Reviewer HvMV
Thank you again for your thorough and detailed review. We fully acknowledge the depth of your concerns and have been working carefully through each point. We would very much appreciate your thoughts on our rebuttal when you have a chance — even a brief response would be invaluable to us. Looking forward to your reply and further discussion.
Response to Reviewer HvMV (Part 1/2)
We apologize for the delayed response, as we have been occupied with several time-sensitive commitments over the past few days.
We thank the reviewer for the careful and detailed feedback. We first address the implementation of the baseline methods raised in W1 and Q1, and then clarify the Chronos feedback mechanism and its empirical contribution in response to W2, Q2, and Q3.
W1 and Q1: Implementation and Integration of the Baselines
We thank the reviewer for noting that the original description of the baseline implementations was insufficient. We clarify that we did not directly reproduce the original end-to-end training pipelines of TQNet and KUP-BI. Instead, we adapted them as external enhancement methods under the shared frozen-forecaster protocol. The revised manuscript now provides the corresponding implementation details.
For TQNet-Post, we first use the fully frozen base forecaster to produce the base forecast. In parallel, the temporal-query, cross-variable attention, and MLP pathways of TQNet generate a residual prediction from the historical window, which is then added to the base forecast through learnable channel-wise gates. During training, we optimize only this residual plugin, including the temporal query, attention projections, input projection, residual MLP, output projection, and channel-wise gates. All parameters of the base forecaster remain frozen throughout.
For KUP-BI-Frozen, we retain the variable-wise retrieval mechanism based on history--target--continuation chains constructed from the training set. The retrieved information is used to construct an auxiliary historical window, xaux, after which the same frozen forecaster separately computes f(x) and f(xaux). The two forecasts are fused at the output level using the original GatedFusion module. Under the current
dynamic_gate=Falsesetting, only the channel-wise static gating parameters are trained, while both the retrieval library and the base forecaster remain fixed.For both adaptations, plugin parameters are optimized only on the training set, checkpoints are selected using the validation set, and all parameters remain fixed during testing. The revised manuscript now explicitly lists the retained components of the original methods, the modifications required by the frozen-forecaster protocol, the trainable parameters, and the training settings. These results should therefore be interpreted as comparisons between adapted methods under a unified frozen-forecaster protocol, rather than as direct reproductions of the original end-to-end configurations.
W2 and Q2: Interval-Width Feedback for Chronos
We thank the reviewer for identifying this issue. The reviewer is correct that the raw prediction-interval width
HC1∑h,c(Qt,h,c,0.9−Qt,h,c,0.1)
is invariant to a common additive residual correction. If removing a prototype removes the same additive term from the lower and upper quantiles, the interval width is unchanged before and after removal. Consequently, the raw interval width cannot itself produce nonzero leave-one-out credit. The original Eq. 15 and its accompanying description conflated this diagnostic uncertainty statistic with the cross-view stability term used in the implementation.
In the implementation, we treat Q0.1, Q0.5, and Q0.9 as three probabilistic forecast views. Each view forms its own retrieval query and separately passes through the Adapter, Retrieval, and Gating modules, producing a corrected quantile forecast Qt,h,c,p. The view loss used for online updating is the dispersion among these corrected quantile forecasts:
Qˉt,h,c=31∑p∈{0.1,0.5,0.9}Qt,h,c,p,
\left(\widetilde Q_{t,h,c,p}-\bar Q_{t,h,c}\right)^2.$$ Because the three quantile views use different queries, retrieval weights, and candidate-prototype participation patterns, removing a prototype need not remove the same residual correction from all three views. Therefore, the implemented quantity $$\mathcal L_{V,t}^{(-i)}-\mathcal L_{V,t}$$ can be nonzero. We directly measured this quantity in the new diagnostic. On ETTm1 at $H=336$, the corrected-quantile view credit was nonzero in 24.74%, 39.57%, and 21.32% of candidate leave-one-out evaluations for the three random seeds, respectively. The corresponding mean absolute values were $4.796\times10^{-4}$, $1.361\times10^{-3}$, and $1.561\times10^{-3}$. These measurements confirm that, unlike the raw interval width, the corrected-quantile view term used in the implementation does not cancel identically and can provide nonzero prototype-level feedback for mirror descent.