- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
STEPS revises a frozen forecaster’s outputs by combining historical spectral bias estimation, prefix-conditioned error propagation, and orthogonal fusion, with promising reported gains but unresolved concerns about experimental consistency and comparison fairness.
Critical strengths
- STEPS provides a practical way to revise forecasts from delayed feedback without updating the backbone or performing online gradient optimization.
- The evaluation spans six datasets, seven backbones, and four horizons, reporting a substantial average MSE reduction of 24.85%.
- The spectral diagnostics, shuffled-prefix controls, and recent-change analysis provide evidence that forecast residuals contain structure useful for correction.
Critical weaknesses
- The comparison does not clearly establish equal feedback availability, revision timing, and access to training residuals across methods.
- The ablations suggest that local error propagation accounts for most gains, leaving the necessity of spectral reconstruction and orthogonal fusion insufficiently demonstrated.
- Robustness testing is limited to Gaussian prefix corruption on one backbone and horizon, leaving sensitivity to recent outliers, missing observations, and persistent disturbances unclear.
Questions for authors
- Do the improvements persist when all methods receive the same feedback and training information and are evaluated at the same revision time?
- How does STEPS compare with a direct ridge predictor mapping observed prefix residuals to future residuals under matched regularization?
- Under what conditions do MSBR and OCC consistently improve over ST-TEP alone and validation-tuned direct addition?
- How does STEPS behave when prefix corruption is temporally concentrated or consists of outliers, missing observations, or persistent shifts?
- How does STEPS relate to TameR’s spectral approach to recent-data robustness (Xu et al., 2026), and does it provide additional gains when applied to a TameR backbone?
Xu, L., et al. (2026). Taming the Recent-Data Bias: Towards Robust Time Series Forecasting with Global Context. ICML 2026.
2 comments
Thanks for the response, which address most of my comments. I will raise my score.
Response to 3vu6: conditions for complementary gains and controlled evidence
Thank you for the constructive questions. We distinguish the effects that are directly supported by the submitted experiments from comparisons that require additional evidence.
Q3: When do the global branch and OCC help? The clearest reported setting is Table 2: DLinear, six datasets, H=720, a=320, and MSE on the remaining 400 steps under 1-30% Gaussian prefix corruption. At every tested level, full STEPS has lower mean MSE than both local-only ST-TEP and Additive. At 1% corruption, Additive/ST-TEP/OCC are 0.4160/0.3601/0.3584; at 30%, 0.7644/0.7066/0.6938. OCC lowers MSE relative to Additive by 9.24%-13.85% across the five levels. Its additional improvement over local-only is smaller, 0.47%-1.81%, but positive at every level.
These two comparisons answer different questions. Removing OCC while keeping both branches gives Additive and tests overlap removal. Keeping only ST-TEP removes the global information as well and tests complementarity. ST-TEP propagates the current observed residual pattern; MSBR reconstructs persistent bias from multiscale residual history and current descriptors. Their corrections can overlap, so direct addition can apply the same direction twice. OCC retains the local response and adds only the global complement (up to the numerical stabilizer). The Table 2 ablation supports this fusion design: direct addition is worse than local-only, whereas the orthogonal complement yields a combined correction that improves over local-only.
The clean H=192 results in Table A10 demonstrate the local branch's near-term strength: 50.7% near-suffix reduction. They do not establish that persistent-bias correction or overlap removal is redundant at H=720 under perturbed feedback. We also do not attribute the entire cross-table difference to horizon length, since the protocols differ in other respects. These are observed conditional benefits, not a claim that every component wins in every cell.
Q1: Same information and revision time. The existing evidence separates two points. First, recomputation of the reported Table A14 paired results gives 25.05% mean full-horizon reduction over the corresponding frozen forecasts, with improvements in all 168 pairs. Second, Table A10 controls how the same revealed prefix is used: temporal permutation reduces near-suffix gain from 50.7% to 27.9%, and last-residual continuation gives 1.0% full-suffix improvement versus 37.1% for ST-TEP. Thus, useful residual structure matters beyond simply receiving observations. These findings do not establish matched training access, feedback schedules and revision times for all competing methods; the published cross-method entries must not be treated as resolving that separate question.
Q2: Direct prefix-to-suffix ridge. Appendix B derives ST-TEP's exact latent-ridge representation: with F=Phi_m A^(1/2), minimizing ||F_B u-r_B||^2 + eta||u||^2 yields F_U u=K_UB(K_BB+eta I)^(-1)r_B. This explains the regularized inference in the empirical residual subspace. It does not show an advantage over a direct unrestricted ridge predictor trained on prefix/suffix pairs. The submission does not report that matched comparison. Such a comparison must align residual normalization, centering/intercepts, channel pooling, validation budget and scored targets, rather than equating penalty values across different scalings.
Q4: Other disturbances. Table 2 supports the stated Gaussian-corruption result. Table A11 additionally examines naturally occurring large recent changes: on that subset, ST-TEP and STEPS achieve 41.1% and 40.4% near-suffix improvement, respectively. This is evidence of responding after a change becomes observable, not a controlled persistent-shift experiment. Temporally concentrated corruption, missing observations and other outlier processes are not established by these tests. In particular, finite linear sensitivity is not an arbitrary-outlier robustness guarantee.
Q5: Relation to TameR. TameR addresses recent-data bias within the forecasting model using global context and spectral/periodicity modeling. STEPS intervenes at a different stage: it revises an already-issued forecast after partial targets become available, without updating the backbone. A frozen TameR model could supply the forecasts and calibration residuals needed by STEPS, but compatibility alone does not establish extra accuracy; TameR may change the residual structure available to the corrector. No TameR+STEPS experiment is reported in the submission.
We hope the distinction between global complementarity and overlap removal, together with the explicit long-horizon ablation numbers, clarifies the role of the complete framework.