- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SWiT, a lightweight test-time adapter that corrects the predictions of a frozen time-series forecasting model in the frequency domain. Each frequency bin is corrected using a scaled prediction, a contribution from the input history, and a bias aligned with absolute time. The correction coefficients are computed in closed form from accumulated statistics, avoiding gradient-based optimization. The method also incorporates partially observed ground truth before the full forecast horizon has elapsed, while an evidence gate controls how much correction to apply based on its effectiveness on past forecasts. Experiments across six backbones and nine datasets show improved average forecasting accuracy with fewer adapter parameters and lower adaptation cost than the compared TTA methods.
Critical strengths
- Reduces parameter count and adaptation cost while improving forecasting accuracy through frequency-wise correction and closed-form updates.
- Evaluated across multiple backbones and datasets, with comparisons against time-domain and dense correctors that support the design choices.
Critical weaknesses
- The conceptual novelty appears limited, mainly combining frequency-wise linear correction with least-squares estimation. The new insight beyond an efficient adaptation procedure is not sufficiently clear.
- The conditions under which independent per-frequency correction is sufficient remain underexplored. Dense-corrector comparisons are provided, but the limits under changing frequencies, phase shifts, and cross-frequency dependencies are unclear. Benefits on strong foundation models are also untested.
Questions for authors
- Under what conditions can forecast errors be adequately corrected by independent linear maps per frequency?
- Controlled experiments varying frequency, phase, and cross-frequency dependencies would help establish when this restriction works and when it fails.
- Do the gains mainly come from correcting persistent backbone errors or from adapting to distribution shifts?
- Separating these effects and testing stronger backbones, including foundation models, would help clarify the scope of the contribution.
3 comments
Thank you for the substantial additional experiments. The controlled frequency and phase perturbations clarify the limits of independent per-bin correction, while the frozen-corrector comparisons and foundation-model results substantially address my questions about the source and scope of the gains.
Some limitations remain: the diagonal–dense comparison does not establish that forecast errors are inherently diagonal, and accumulated statistics can slow adaptation after abrupt shifts. Nevertheless, the additional evidence strengthens the contribution sufficiently for me to support raising my rating to weak acceptance.
We sincerely thank the reviewer for the positive assessment and for supporting a higher rating. We will reflect both limitations in the revision.
Diagonal versus dense correction. As the reviewer notes, the comparison shows that diagonal correction suffices on the evaluated benchmarks, and it does not establish that forecast errors are inherently diagonal. The perturbations also show its limit when energy moves across bins (Appendix K.2). We will state the diagonal structure as an empirical finding and list shifts across bins as a limitation.
Adaptation after abrupt shifts. We agree. Forgetting did not help on the benchmark streams (Appendix E.7), but after a regime switch it lowers the MSE from 0.4036 to 0.3852 (Appendix K.3). We provide it as an option that keeps the closed form, and we will state this trade-off as a limitation.
We thank the reviewer again for the time and effort devoted to our work and for the constructive discussion, which has substantially improved the paper.
W1 - Novelty beyond Efficiency
SWiT rests on three findings, now stated more clearly in Section 1. Other reviews note the same points as the reviewer's second strength: the diagonal frequency-domain corrector beats its time-domain counterpart and ties a dense one (ugA6), and the spectral formulation connects representation, optimization, and efficiency (yMsM).
New findings from the rebuttal experiments.
W2, Q1 - When Per-Frequency Correction Suffices
We added controlled changes to the ETTh1 and ETTh2 test splits at two strengths (3 backbones × 4 horizons, seed 0): harmonic (H) and weekly (L) amplitude, phase drift (P), a one-time phase step (PS), a frequency chirp (F), and cross-frequency modulation (C).
(Removed share: the fraction of the added No TTA error that SWiT removes. The g = 0.75 rows add no error; Appendix K.2 gives all rows.)
SWiT beats No TTA in all 24 settings.
On the real benchmarks, a dense frequency-domain corrector is not better than the diagonal one (Appendix E.3), so the error there comes mostly from changes in one bin.
W2, Q2 - Source of the Gains and Foundation Models
Source of the gains. We froze the corrector in two ways (72 cells, 5 seeds; General Response, Section 1): SWiT-val fits on validation, and SWiT-prefix adapts on the first 20% of the test stream. They decrease the MSE from No TTA by 6.1% and 3.9%, and SWiT by 10.8%. Persistent error thus gives more than half of the gain; SWiT-prefix is worse than SWiT-val because it uses fewer windows; and continued adaptation adds a consistent gain (SWiT beats SWiT-prefix on 71 of 72 cells, p = 5.3 × 10⁻¹³).
Foundation models. We applied SWiT without training (context 96, 5 datasets, 20 cells for each model, seed 0).
SWiT decreases the MSE by 35.0%, 16.9%, and 39.8%; the existing methods get 26.4% to 27.7%, 6.5% to 8.9%, and 23.2% to 25.1%. SWiT has the lowest MSE in 54 of 60 cells and the lowest MAE on all models (Appendix M).