- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(−1)
Read review
Paper summary
The paper introduces CasEm, a method to improve ML-based long-horizon forecasts that are usually subject to accumulated errors or instability due to the use of autoregressive rollout (chaining output of the previous inference as the input of the next one). CasEm proposes a cascade rollout where a smaller sidecar model is used to correct the main model over the prediction of big quantities. The feedback is unidirectional and hence guarantees the evolution of the sidecar model without influence of the main model errors. The paper derives an error bound expressing a trade-off between coverage, modelability, and correctability, and provide guidance to choose the sidecar. The approach is tested in four ODE/PDE benchmarks and a 10-year climate emulation, showing significant reduction of long-horizon forecast error at little computational cost.
Critical strengths
The problem explanation and the objective are clear. The proposed solution is simple to understand and to apply, and effectively cheap. The unidirectional feedback ablation directly tests the paper design choice. Code and configurations are provided
Critical weaknesses
The evaluation baselines are not strong enough, and results are not discussed enough. One example is related to the climate emulation, where the climatology may impact the interpretation. In Table 18, a constant 10-year-mean target gives full-state TM 0.046 vs 0.040 for full CasEm, compared with 0.079 for Base S-DY (Table 2), which suggest most of the gain survives a time-constant target and may come from a training climatology. Table 14 shows robustness results averaged over IC1–11, but IC1-10 were used to fit the subsystem (section E.2) The reading is difficult, the main content relying on many results provided in appendices.
Questions for authors
A. Could you add a simple climatology-based subsystem (not learned) to clearly state if CasEm beats it?
B. Were the correction hyperparameters (gain, cap, interval, grid) selected on IC11? Do the 11 trajectories share the same forcing? An evaluation under different forcing would strengthen the generalization claim
A clear win over the climatology baseline in A and more robust evaluations would raise my score
3 comments
Thank you for suggesting the climatology baseline and the evaluation under different forcing; we have added both experiments and clarified that the correction settings were chosen without using the held-out test trajectory. We hope the new results answer your questions about robustness and would be happy to discuss any remaining concerns.
Thank you for taking the time to add the new experiments, they strengthen your evaluation and clarify the impact of your approach. I still have some concerns about the overall reading of the article, for which I have no clear hints you took my remark into consideration.
R1–R2: Questions A–B
R1 : climatology baseline (A)
We thank the reviewer for this suggestion. We have added a simple, non-learned climatology baseline, in which the water targets are computed directly as training-set means and held fixed throughout the ten-year rollout. This differs from the existing ten-year-mean ablation, whose constant targets are obtained by averaging the learned subsystem’s rollout and therefore retain information learned by that subsystem.
Results and analysis. Full CasEm clearly outperforms the non-learned training-set climatology baseline on all four metrics, reducing full-state TM and ST by 39.5% and 2.4%, and total-water TM and ST by 51.3% and 16.2%, respectively. Both the training-set climatology and the rollout-mean target are constant in time, yet the latter yields lower errors. This shows that the gains retained by the ten-year-mean ablation cannot be reproduced by simply imposing the training climatology. Full CasEm further improves all four metrics over the rollout-mean target, indicating an additional benefit from retaining the subsystem’s time-varying forecasts.
R2: Hyperparameter selection and robustness under different forcing
Were the correction hyperparameters selected on IC11? No. The aggregation grid, correction interval, and gain were chosen using development data IC10 and fixed for the IC11 evaluation. The default pseudoinverse correction itself is determined by H. Although we used a gain of 0.5 to control the correction magnitude, our additional experiments show that this scaling is not necessary: removing it (i.e., using a gain of 1) has little effect on the final performance.
Do the 11 trajectories share the same forcing? Yes. They form an initial-condition ensemble with the same prescribed forcing, including annually repeating climatological SST and solar forcing, and fixed CO₂ and other greenhouse-gas concentrations. This follows the FV3GFS benchmark used by ACE [1] and Spherical DYffusion [2]. These trajectories therefore test sensitivity to initial conditions rather than generalization across forcing conditions.
Additional evaluation under different forcing. We added experiments using the SHiELD AMIP-constant-CO₂ dataset, which uses historically varying SST rather than the annually repeating SST climatology of the original benchmark, with CO₂ held at its 1979 level [3]. This also changes the reference simulator from FV3GFS to SHiELD.
Since S-DY was not trained on this SHiELD setting, we evaluate its transfer over seven independently initialized three-year windows. We also evaluate ACE2S-SHiELD+, pretrained on SHiELD simulations including AMIP data, abbreviated as ACE2S below. Both backbones remain frozen. The total-water subsystem is fitted on 2001–2006 and validated on 2007–2008; evaluation uses 1980–2000.
Results. The table above summarizes the average relative error reductions across the seven three-year evaluation windows. CasEm reduces all four error metrics relative to Base for both backbones in every window, supporting robustness across the tested initialization years and prescribed forcing trajectories. We have also added this experiment to Appendix E.3.2, where Table 18 reports the per-window results, including Oracle.
References
[1] Watt-Meyer, O., et al. (2023). ACE: A fast, skillful learned global atmospheric model for climate prediction. arXiv:2310.02074.
[2] Rühling Cachay, S., Henn, B., Watt-Meyer, O., Bretherton, C. S., & Yu, R. (2024). Probabilistic Emulation of a Global Climate Model with Spherical DYffusion. Advances in Neural Information Processing Systems, 37.
[3] Clark, S. K., et al. (2026). Disentangling the effects of sea surface temperature and CO₂ in global machine learned weather-climate emulators. arXiv:2606.07928.