-
The conceptual novelty is overstated, and the significance of the remaining architectural contribution is insufficiently established.
Advancing the forecasting origin and generating updated predictions when observations arrive is established rolling-origin forecasting. This can be done by updating the input context without refitting model parameters, as discussed explicitly in Section 4.1.2 of [1]. Furthermore, TAFAS [2], which the submission itself cites, already uses partially observed targets to revise the still-unobserved portion of a forecast while retaining predictions for elapsed timestamps. Thus, revising predictions within the current target horizon is also insufficient to establish a new forecasting paradigm.
The defensible methodological contribution therefore lies primarily in the particular combination of recurrent residual memory, forecast fusion, and affine modulation. This is a coherent design, but the paper does not sufficiently demonstrate that this combination constitutes a substantial advance beyond a straightforward rolling forecaster. Because introducing a new paradigm is presented as a central contribution, the gap between that framing and the narrower architectural contribution materially affects my assessment of the paper’s significance
-
The headline evaluation does not adequately establish the contribution, reliability, or practical value of the additional revision machinery.
Section 3 evaluates the concatenation of successively committed blocks. Each scored prediction is therefore issued at most B steps before its target, whereas fixed-origin forecasting evaluates predictions extending up to H steps without intervening observations. Substantial improvements are unsurprising when forecasts receive newer information and are evaluated at shorter lead times. Hence, the reported 87.9% MSE reduction on Exchange does not establish an improvement of that magnitude attributable to PRISM’s architecture under matched forecasting conditions.
Figure 2 illustrates the distinction. On ETTh1, ETTm1, and Weather, naive re-encoding achieves approximately 89–92% of the absolute MSE reduction from the fixed-origin backbone to complete PRISM. The additional relative reductions from the complete model are 2.6%, 3.8%, and 6.4%, respectively, as Section 5.3 acknowledges. These figures apply to the three ablation datasets and do not directly decompose the Exchange result. Nevertheless, they show why the incremental architectural contribution requires more careful validation than the headline results provide.
Appendix A.4 partially addresses this concern, but its matched-protocol evaluation covers only one dataset and two horizons. It is also unclear whether naive re-encoding receives the same progressive training objective and tuning budget. No direct comparison quantifies the additional inference cost of the memory, fusion, and modulation components relative to naive re-encoding.
-
The presentation and statistical reporting of the main results further impede assessment. Table 1 is extremely difficult to parse because of its very small text and dense arrangement of datasets, horizons, models, and metrics. Although the results are averaged over five independent runs, the table provides no standard deviations or confidence intervals. The component ablations likewise lack uncertainty estimates, making it difficult to assess the reliability of the relatively modest incremental improvements. The unspecified main-experiment block size and the unexplained difference between the main and appendix Weather results introduce additional uncertainty about the experimental conditions.
Taken together, the evidence does not yet establish that the added architectural complexity delivers a sufficiently reliable and general benefit to support the paper’s claims.
References
[1] Hansika Hewamalage, Klaus Ackermann, and Christoph Bergmeir. “Forecast evaluation for data scientists: common pitfalls and best practices.” Data Mining and Knowledge Discovery, 37, 788–832, 2023. DOI: 10.1007/s10618-022-00894-5.
[2] HyunGi Kim, Siwon Kim, Jisoo Mok, and Sungroh Yoon. “Battling the Non-stationarity in Time Series Forecasting via Test-time Adaptation.” Proceedings of the AAAI Conference on Artificial Intelligence, 39(17), 17868–17876, 2025. DOI: 10.1609/aaai.v39i17.33965.