- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper develops an exact risk theory for instance normalization (RevIN) in linear time-series forecasters and evaluates the resulting diagnostics on eight benchmarks and in preregistered experiments on deep transformers.
Critical strengths
- The paper elevates the study of instance normalization from representational algebra to an exact risk theory, yielding closed-form expressions for the stationary price versus level-shift benefit.
- The author has conducted extensive verification work, and the authors evaluate transfer to PatchTST and iTransformer using frozen, multi-tier preregistrations that report every failed gate and falsified prediction verbatim.
Critical weaknesses
- A large number of unexplained parameters appear in the paper, including those in the abstract. This makes the paper very difficult to understand.
- No relevant prediction theories have been mentioned in recent work. In addition, a large number of py files are presented in the appendix, yet no relevant results are provided. This is the theoretical basis on which I doubt this work.
Questions for authors
- Can the method proposed in this paper explain other normalization methods (except RevIN)?
- Why is there no comparison with other normalization methods?
- Can you explain in simple terms why instance normalization improves performance?
2 comments
Unfortunately, I am not fully convinced. Admittedly, the paper is valuable, yet there is a critical discrepancy between the quantity required by the theory and the quantity actually estimated in the experiments.
We thank the reviewer for the constructive feedback and for recognizing the value of the exact risk analysis and the preregistered experiments.
We have revised the manuscript to address the concerns regarding presentation, related theory, and comparisons with other normalization methods. We respond to the three questions below.
Q1. Can the theory explain normalization methods other than RevIN?
Yes, for a defined class of normalization procedures, although the results do not extend to every learned normalizer.
We have added Table 2 (p. 10) and Appendix B.6 (p. 18) to clarify this scope.
First, any method that subtracts a fixed weighted average of the input window and restores it after prediction, where the weights sum to one, produces the same class of linear forecasters as mean normalization. This includes last-value normalization, as used in NLinear, and fixed exponentially weighted means.
Under unregularized least squares, these methods yield the same fitted forecaster and inherit the same exact risk results. Under ridge regularization, their induced penalties differ, so they need not produce the same fitted estimator.
Second, first differencing spans the same linear hypothesis class, as established in Proposition 4.
Third, Theorem 4 extends the population analysis to known nuisance directions, including level, trend, and fixed seasonal components.
Finally, for linear forecasters, division by a positive window-scale statistic cancels at prediction time but changes the weighting of the training loss (Section 5).
Methods that introduce learned statistics or additional interactions, including Dish-TS, SAN, and NST, are not covered by these results. Table 2 distinguishes the applicable cases from those requiring separate analysis.
Q2. Why are there no comparisons with other normalization methods?
We agree that the original manuscript did not make the existing comparisons sufficiently visible.
The revised Section 9 (pp. 9–10) now brings together the results for four estimators evaluated under the same linear forecasting protocol: no normalization, mean normalization, full instance normalization, and differencing.
Across 32 dataset–horizon settings, mean normalization achieves the lowest reported test MSE in 13 settings, the unnormalized model in 12, differencing in 5, and full instance normalization in 3. One tie is counted for both mean normalization and the unnormalized model.
Mean normalization and differencing differ by less than 0.01 MSE in 27 settings, consistent with their shared hypothesis class but different regularized estimators.
We also report an explicitly post hoc comparison involving full RevIN on the deep backbones in Appendix S.
We acknowledge that we have not conducted experimental comparisons with learned normalizers such as SAN or Dish-TS. The new Table 2 provides an analytical comparison, but this does not replace a direct empirical benchmark.
Q3. Why does instance normalization improve forecasting performance?
The intuition is that instance normalization makes the forecast respond to a common change in the level of the input and target.
Suppose a model was trained on a series centered around zero, but the series subsequently shifts to a higher level. An unnormalized model may continue forecasting toward the old mean, producing systematic error.
Mean normalization removes the current window level before prediction and restores it afterward. The resulting forecast responds to the shift exactly, avoiding this source of error.
However, this response has a cost. If fluctuations in the window mean are temporary rather than persistent, normalization forces the forecast to follow them.
Our main result quantifies this trade-off. For unregularized population least squares, normalization is preferable precisely when the squared deployment shift exceeds the variance of the best linear unbiased estimate of the window level.
Section 1.1 (pp. 1–2) now develops this explanation through a numerical forecasting example.
Additional clarification of novelty and related work.
We have expanded the discussion of recent forecasting theory, including Toner and Darlow (2024), Huang et al. (2026), and Wang et al. (2026). We also cite Herbreteau et al. (2023) and Saied and Fleuret (2026) for established normalization-equivariance properties.
We do not claim novelty for the sum-to-one identity or the general equivariance of the normalization wrapper. Our contribution is the exact risk analysis and its consequences for forecasting.
Finally, Appendix U now summarizes verification results alongside their corresponding claims and scripts, rather than presenting raw console output without a clear connection to the theoretical statements.
We hope these revisions address the main concerns and clarify both the contribution and its limitations.