- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the weight-space structure of weather foundation models fine-tuned for different forecast horizons, and proposes using low-loss temporal connectivity to construct intermediate-horizon forecasters. The main experiments start from the public 6-hour Aurora checkpoint and further fine-tune 3-hour and 1-hour models. CKA and related analyses are used to examine the internal representational similarity of different lead-time adaptations. For the 3-hour and 6-hour models that remain in a nearby region of weight space, the paper directly performs linear weight interpolation to obtain 4-hour and 5-hour forecasters without separately training models for those intermediate horizons. The phenomenon is further examined on Pangu-Weather and GraphCast, with comparisons against autoregressive chaining and conventional grid-space interpolation in terms of RMSE, spectral fidelity, and computational cost.
Critical strengths
1. The paper addresses a practical problem caused by the fixed forecast steps of weather foundation models. Many current weather models only provide forecasts at a small set of predefined lead times, whereas downstream ocean, sea-ice, hydrology, air-quality, and higher-frequency data-assimilation systems may require atmospheric forcing at cadences that do not match those fixed horizons. Recovering intermediate states without separately training a model for every target horizon therefore has clear practical relevance.
2. In the main Aurora experiments, weight interpolation provides a favorable trade-off between forecast accuracy and spectral fidelity without additional training for the intermediate horizons. At 4 h and 5 h, LWI outperforms the conventional grid-space interpolation baselines on T2m, T850, U10, and V10. The advantage is even more pronounced in meso- error energy, where the error is reduced by up to about a factor of two relative to cubic-spline interpolation for some variables.
Critical weaknesses
1. The Related Work omits a directly relevant line of learned temporal interpolation / temporal super-resolution methods. The paper mainly positions itself through weather foundation models, weight interpolation/mode connectivity, and continuous-time forecasting, but does not systematically discuss learned approaches that reconstruct intermediate states between two known time points, such as weather temporal interpolation, spatio-temporal temporal super-resolution, neural-field methods, or other learned frame-interpolation models. This omission is particularly relevant because the paper attributes the weakness of grid-space interpolation to its inability to reconstruct smoothed fine-scale and high-frequency structure, whereas learned temporal interpolation methods are explicitly designed to model nonlinear evolution and recover intermediate details.
2. The cross-architecture validation on Pangu-Weather relies on a fine-tuned endpoint that is substantially weaker than the official model, which limits the practical value of that part of the evaluation. To obtain an interpolable shared basin, the authors fine-tune a new 3-hour anchor from the official Pangu 6-hour checkpoint. However, this model reaches a Z500 RMSE of 22.2 at 3 h, compared with 13.1 for the independently trained official 3-hour model. More importantly, Pangu officially provides 1-hour, 3-hour, and 6-hour models, yet the paper does not directly compare the interpolated models against 4-hour and 5-hour autoregressive chains constructed from these higher-quality official checkpoints. The paper itself also notes that the light-budget Pangu and GraphCast anchors and their interpolants are not competitive in absolute skill with well-tuned native checkpoints. Thus, this experiment provides useful evidence about the conditions under which shared-basin connectivity can emerge, but does not yet establish that such connectivity can be retained while maintaining competitive endpoint forecast skill.
Questions for authors
1. Learned output-space temporal interpolation. The current grid-space interpolation baselines mainly include linear/quadratic interpolation, cubic splines, linear tendency, and persistence. Have the authors considered learned temporal interpolation or temporal super-resolution methods, such as neural-operator-based weather interpolation, motion-aware interpolation, or other spatio-temporal interpolation networks? If not, what was the main reason? Since spectral fidelity is presented as an important advantage of LWI over grid-space interpolation, whether learned output-space methods can similarly recover mesoscale/high-frequency energy would directly affect the scope of this conclusion.
2. Official Pangu-Weather checkpoint combinations. Pangu-Weather officially provides independently trained 1-hour, 3-hour, and 6-hour checkpoints. Have the authors compared the 4-hour and 5-hour interpolated models against autoregressive chains formed from the official 1-hour and 3-hour models, such as 1h→3h and 1h→1h→3h? If not, why was this comparison omitted? This is particularly important because the fine-tuned 3-hour anchor used for interpolation is substantially weaker than the official 3-hour model.
3 comments
W2 / Q2: the Pangu-Weather anchor and the official checkpoint chains
You were right on both counts: the fine-tuned Pangu-Weather 3h anchor of the submission (Z500 22.2 at 3 h) was much weaker than the official 3h model (13.1), and the official chains were not evaluated. Thus, we fine-tuned a new 3h anchor from the official 6h weights to reach the official model's skill: Z500 13.8 at 3 h against 13.14. With it the valley is deeper and better placed than before: at 4 h the minimum lies 53 % below the better endpoint and at 5 h 38.5 % below, ε(λ) < 0 at every interior λ, and λ* = 0.35 and 0.70 against the nominal 1/3 and 2/3 (Table 21, Fig. 2b; 64 initializations of 2022). Then we benchmarked the interpolants, at the nominal and uncalibrated λ, against the official 1h→3h and 1h→1h→3h chains you asked for, on 256 initializations (RMSE, Table 22):
| Z500 | T850 | U10 | V10 | T2m | |
|---|---|---|---|---|---|
| 4 h, LWI | 27.14 | 0.446 | 0.492 | 0.498 | 0.620 |
| 4 h, chain 1h→3h | 26.36 | 0.452 | 0.519 | 0.522 | 0.622 |
| 5 h, LWI | 28.01 | 0.480 | 0.553 | 0.565 | 0.637 |
| 5 h, chain 1h→1h→3h | 27.46 | 0.489 | 0.565 | 0.574 | 0.645 |
LWI is 3 % and 2 % behind on Z500, ahead on T850 and the 10 m winds at both horizons, and level or ahead on T2m, in one forward pass instead of two or three. Sec. 4.1 and Sec. 8 now describe this anchor.
So connectivity and competitive endpoint skill coexist, on Pangu-Weather as on Aurora. On Aurora we fine-tuned a 6h model from Microsoft's released 12-hour checkpoint. At its own horizon it matches the independently trained official 6h checkpoint (Z500 19.1 ± 3.2 vs 18.8 ± 3.9), and interpolating it with the 12h checkpoint gives an interior minimum at all four interior horizons 7–10 h, 22–39 % below the better endpoint on 64 of 64 initializations, with λ* within one grid step of the nominal (T* − 6)/6 (Sec. 4, Fig. 1, Appendix I). Interpolating the official 6h and 12h checkpoints instead crosses a barrier 1.7–2.6× worse than persistence. Once again, what a pair needs to be interpolable is a shared parent, and the anchor does not have to be weak. The GraphCast anchors, which you also named, remain light-budget proofs of concept (Sec. 8); we did not retrain them.
On Aurora the chains you ask for are in Table 1 (1h→3h at 4 h, 1h→1h→3h at 5 h): the chain wins Z500 by 4.8 and 5.4 m²/s² and loses T2m, T850 and the winds (V10 at 5 h is a tie), at two to three times LWI's inference cost.
Changes in the revised PDF: Sec. 4.1, Tables 21–22 and Fig. 2b (the new Pangu-Weather anchor and the official chains); Sec. 8 (anchor quality); Sec. 4 and Appendix I (the 6–12 h segment).
Post Rebuttal Comment
Thank you for the detailed rebuttal and additional experiments.
W1/Q1: The expanded related work and narrowed claims address part of my concern. However, without a direct comparison, it remains unclear how LWI performs against learned temporal interpolation in terms of spectral fidelity. The conditional-mean smoothing argument does not, by itself, establish a general advantage over deterministic learned interpolators.
W2/Q2: This concern has been substantially addressed. The improved Pangu-Weather anchor and comparisons with official autoregressive chains provide stronger evidence that shared-basin connectivity can coexist with competitive forecast skill.
Overall, I appreciate the substantial improvements, particularly the additional experimental validation. Nevertheless, the remaining limitation regarding learned temporal interpolation leads me to maintain my original score.
The authors thank the reviewer 7fuU for reading the manuscript and for naming its weaknesses precisely. Both are addressed in the revised PDF, and this comment covers the first one.
W1 / Q1: learned temporal interpolation
You are right that this line of work was missing from our Related Work, and our one-line description of FuXi-2.0 made the gap worse: we wrote that hourly output "required a new model" without saying that the new model is a learned temporal interpolator. The revised PDF corrects that sentence and adds a paragraph on learned temporal interpolation (Sec. 2), which covers FuXi-2.0's interpolator, ModAFNO, HourGlass, TemDeep, STint and AtmoRep.
We did not compare with them in the paper for three reasons.
First, they answer a different question. Each of them takes a completed 6 h forecast and reconstructs what lies between two forecast states. LWI is a forecaster: it produces the 4 h state from (t−4 h, t) in one forward pass, without a 6 h forecast. For the uses that motivate the paper (forcing a coupled model, a sub-6 h assimilation cycle) the quantity needed is the state at t+4 h given t.
Second, they cost what LWI removes. The interpolator is a forecaster-sized network that has to be trained: FuXi-2.0 trains it on its own 6-hourly model's outputs; ModAFNO used about 1300 H100-hours on ERA5 pairs and was not applied to a forecast model's outputs; HourGlass is trained on IFS forecast trajectories. This is the cost class of our natively fine-tuned 4h and 5h models, which Table 1 already reports as the upper reference and which lead LWI by 7–33 %. The output-space baselines of Sections 5–6 are the training-free ones, and the revised text says so.
Third, the spectral question. A learned deterministic interpolator does fix what the cubic spline cannot: motion-aware methods displace features coherently instead of blending them. However, it cannot deterministically regenerate structure whose lifetime is shorter than the bracket: there the intermediate state is not a function of the two bracketing states, and a network trained with an MSE or Charbonnier loss returns their conditional mean, which is a smoothed field. HourGlass motivates its probabilistic design by exactly this observation, and ModAFNO reports no spectra. A CRPS-trained interpolator recovers small-scale energy as samples, which is a different object from a deterministic forecast. LWI's spectrum comes from being a forecaster trained against full-resolution ERA5, with no training at the interior horizon and no sampling.
Thus, the comparison with output-space baselines is now scoped to training-free ones: "every training-free grid-space interpolation baseline" in the abstract, and the same scope in Sec. 2 and the conclusion. Against a learned deterministic interpolator trained on our own anchors' 3 h and 6 h forecasts at the anchors' budget, we expect LWI to keep the spectrum and the interpolator to keep a point-error edge. This is an expectation and we have no result for it. It is the one baseline we would add given the compute of a training run, which is beyond the discussion period; Sec. 8 names it as the missing comparison.
Once again, every prior route to an intermediate horizon (Pangu-Weather's additional models, lead-time conditioning, the learned interpolators) trains a network for it. The question this paper asks is whether the horizon is already encoded between two checkpoints that exist.
Changes in the revised PDF: Sec. 2 (corrected FuXi-2.0 sentence, new paragraph "Learned temporal interpolation"); abstract, Sec. 2 and Sec. 9 (scope of the spectral claim); Sec. 8 (the missing baseline).