- Rating
- 3
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The work introduces a post-hoc correction framework designed for frozen time-series forecasters. Structured linear residual correctors are fitted in the frequency domain, while their structural complexity, regularization strength, and fitting source are determined via validation, together with block-wise gating. A theoretical analysis delineates the recoverable error and the associated estimation trade-offs. Across eight datasets, ten backbone models, and four prediction horizons, the method yields improvements in 279 out of 320 configurations, achieving an average relative MSE reduction of 6.34%.
Critical strengths
- The manuscript tackles a practically motivated question: how to enhance a frozen forecaster while leaving the backbone untouched.
- The structured correction framework is logically coherent, and the theoretical treatment sheds light on the recoverable error as well as the tension between approximation and estimation.
- The empirical study encompasses a range of datasets, architectures, forecasting horizons, and random seeds, thereby furnishing ample evidence of its practical value.
- The method's usefulness is further corroborated by the comparative analyses, composition experiments, and ablation studies. The decision to report negative outcomes and metric trade-offs adds to the clarity of the exposition.
Critical weaknesses
- The practical necessity of gating over and above ridge regularization remains insufficiently substantiated. A dedicated ablation study would help pinpoint the failure mode it is intended to address and quantify its actual contribution.
- Benchmarking against alternative structures under matched regularization and selection budgets would further bolster the case for the proposed G2–G5 family.
- The link between the multi-seed variance diagnostics and the deployed structural choices remains indirect.
Questions for authors
Please see weakness
3 comments
Reply to Reviewer AkNK (2/2) — Bridging Multi-Seed Diagnostics to Single-Checkpoint Deployment
W1.3 — Linking multi-seed diagnostics to single-checkpoint deployment
Why do we analyze multi-seed runs in Section 3 when practical deployment provides only one frozen model? In real-world deployment, retraining a forecaster across multiple random seeds solely to measure forecast variance is computationally prohibitive; we are given only a single frozen checkpoint. Our framework bridges offline diagnostics and single-checkpoint deployment through a direct two-stage logic:
- Offline multi-seed diagnostics identify why residual magnitude fails (Paper Sec. 3): Training multiple seeds offline serves as an analytical lens to uncover forecast residual ambiguity—showing that modes with comparable residual energy can hide starkly different run-to-run instability (29% median seed variance in weak-skill bands vs. 0.2% in high-skill bands across 65 cells, Fig. 1 & Table 5). This explains why correction rules based on residual magnitude alone fail: large residuals often reflect high training-run volatility rather than recoverable systematic bias.
- Single-checkpoint risk estimation replaces seed variance at deployment (Theorems 1–3 & Corollary 4): Because cross-seed variance is unobservable when only one checkpoint is given, our theory establishes how to assess structural risk from that single model alone (detailed step-by-step in our Reply to Reviewer JzC7, Part 1, W3). Theorem 1 (Eqs. 8–9) shows how latent seed volatility leaks into a single checkpoint's empirical forecast–error cross-moment alongside true bias, and why dampening seed variance can inflate mean prediction error. Theorems 2–3 and Corollary 4 (Eqs. 11–14) then prove that realized joint moments and cross-fitted validation gain on that one checkpoint directly determine whether expanding from coordinate scaling (G2) to cross-channel or neighboring-mode couplings (G3–G5) captures genuine signal beyond finite-sample estimation error.
- Empirical alignment across 960 real runs and 1,080 synthetic runs (Paper & New): Without ever accessing another seed, our single-checkpoint selector reproduces the exact structural choices that multi-seed diagnostics would prescribe. Across the paper's 960 single-seed runs (Fig. 4b), it contracts to coordinate damping (G2) in 435/480 (90.6%) runs on high-volatility ETT datasets (weak-band seed variance 34%–56%, Table 5), while expanding to G3–G5(3) in 432/480 (90.0%) runs on lower-volatility multivariate datasets (
Weather,Solar,ECL,Traffic; 9%–21%). Consistently, in our new 1,080-run synthetic benchmark, single-sample selection recovers the population-best fitted candidate in 943/960 signal-bearing runs (mean regret ).
Thank you for the additional experiments, which address my first two concerns. The link between multi-seed variance diagnostics and deployment-time structure selection remains indirect. I maintain my rating of Weak Accept.
Reply to Reviewer AkNK (1/2) — Role of Block Gating and Matched-Budget Structural Comparisons
Dear Reviewer AkNK,
Thank you for your constructive review. In Part 1, we isolate the role of block gating beyond ridge regularization and evaluate alternative parameterizations under matched budgets (W1.1, W1.2). Part 2 details how offline multi-seed diagnostics connect to single-checkpoint deployment decisions (W1.3).
W1.1 — Why block gating is needed alongside ridge regularization
In spectral post-hoc correction, a single ridge multiplier faces an inherent trade-off across frequencies. Matrix classes G3–G5(3) tune one global penalty λ shared across all modes via aggregate validation loss (Alg. 1; G2 has no ridge grid). When strong low-frequency improvements dominate that aggregate score, the chosen λ can remain too small for volatile high-frequency modes, letting local overfit slip through. Block gating resolves this mismatch by zeroing out individual harmful modes without over-shrinking informative ones.
To separate gating's contribution from ridge tuning and model reselection, we ran new ablations on frozen ETT and Weather checkpoints:
ETTh2/iTransformer/H96(baseline 0.3091), removing the gate from the selected G2 operator degrades test MSE from 0.3023 to 0.3899, and full ungated reselection only recovers to 0.3054. Across the ETT panel, gating improves all iTransformer means over ungated reselection, with minor trade-offs on DLinear.Weather/iTransformer/H96, global ridge alone already stabilizesT:G5(3)(+8.23% ungated vs. +8.16% gated). Gating thus acts as a conditional safeguard—pruning noisy modes when one global λ is too coarse, while remaining transparent when global regularization suffices.W1.2 — Evaluating alternative structures under matched budgets
A natural question is whether our gains stem from the aligned G2–G5 dependency hierarchy itself, rather than simply having a strong regularization and validation pipeline. In the paper, Tables 3 and 15 already compared published post-hoc adapters on identical splits, while Fig. 5a tested matched-count spectral supports. To evaluate alternative parameterizations under identical ridge grids, cross-fitting folds, block gates, and selection budgets, we added a 1,080-run synthetic benchmark (comparing aligned local supports against equal-count permuted supports) alongside real-data G5 variants:
On
Weather/iTransformer/H96(where validation actively selects G5(3) across all seeds), we further tested permuted frequency neighborhoods and a pre-fixed rank-10 G5 candidate under the exact same 64 ridge values, two fitting sources, and block gates (3-seed means):True frequency adjacency outperforms permuted neighborhoods across all seeds (by a modest 0.20%, since both retain the aligned within-mode G4 channel–phase block driving most of the ~8% gain). Meanwhile, replacing dense G5 with a fixed rank-10 G5 candidate in the selector picks rank-10 G5 once and G3 twice across the three seeds—retaining 81.4% of dense gain while reducing average nominal representation coefficients by 83.9%.