- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Physics-Supervised Any-Time Forecasting (PSAF) for predicting weather fields at fractional lead times using full-field labels available only at integer hours. The method recomposes the latent changes produced by a frozen 6-hour forecasting model and uses a local mixture of neighboring integer-time decoders to generate the requested field. Fractional queries are trained using interpolated geostrophic and kinetic-energy targets together with continuity regularization. The paper evaluates integer-time forecasting, fractional-time accuracy against RTMA-RU, physical diagnostics, spatial structure, and downstream wind-power forecasting.
Critical strengths
- The paper addresses a useful problem, since many downstream weather applications require forecasts at time intervals that do not match the model’s native forecast step.
- The method is clearly described and supported by a broad set of internal analyses, including component ablations, physical diagnostics, boundary continuity, spatial statistics, and a downstream wind-power task.
Critical weaknesses
- The fractional-time comparison is not well controlled because ClimODE and CEF use WeatherBench v1 inputs at 5.625-degree resolution, while PSAF is trained on WeatherBench 2 at 1.5-degree resolution and is only downsampled during evaluation.
- The evidence for arbitrary-time forecasting is limited because the real fractional-time evaluation only tests hourly midpoints, while the stronger and more comparable endpoint-reconstruction baselines are evaluated only at integer lead times.
Questions for authors
-
Can ModAFNO, AMT, UPR-Net, and field interpolation be evaluated on the same fractional RTMA-RU queries?
-
Since RTMA-RU is available every 15 minutes, can the authors report results at 0.25, 0.5, and 0.75 within each hourly interval?
-
Can ClimODE, CEF, and PSAF be compared using matched training data and input resolution?
-
How much of the Local Decoder MoE improvement remains when compared with a parameter-matched time-conditioned shared decoder?
-
How does the method perform during rapidly evolving weather events, where linear interpolation of the physical diagnostics may be inaccurate?
[Additional Comments] The recursive composition result also shows a noticeable gap between a direct 1-hour query and two successive 0.5-hour queries, suggesting that the learned forecasts are not yet temporally composition-consistent.
7 comments
Manuscript revision update
Thank you again for your constructive feedback. We have updated the manuscript with additional results and clarifications from our response. The main text now includes denser RTMA-RU evaluation, interpolation comparisons on RTMA-RU and wind power, and the controlled 2h-to-1h label-holdout experiment. The appendix includes the RTMA-RU component ablations, AMT with historical input, cross-window consistency, and rapid-change evaluations. We have also clarified the method description and evaluation protocols.
Regarding Q4, the parameter-matched, time-conditioned shared decoder comparison is now underway. We will report the results once training and evaluation are complete.
Follow-up on our response
Thank you again for your time and consideration. We would appreciate your feedback on our response and briefly summarize the additional results below.
To address fractional-time evaluation and baseline comparability, we evaluated ModAFNO, AMT, UPR-Net, and field interpolation on the same RTMA-RU queries at 0.25, 0.50, and 0.75 h within each hour. The added learned baselines use the same data source, resolution, and integer training labels as PSAF. PSAF has lower errors than these baselines on all four aggregate metrics (Table 3 of the revised manuscript).
On rapid-change subsets selected from RTMA ground truth, PSAF yields lower temperature-change and wind-vector-change errors than 6h field interpolation and the learned baselines above (Table 17).
Regarding Q4, training of the parameter-matched, time-conditioned shared decoder is ongoing. To match the experts' total parameter count, this control uses a larger shared decoder without MoE routing. Each query runs through the full decoder, increasing computational cost and training time. We hope to complete training before the discussion period ends and will share the results as soon as they are available.
We would welcome your feedback and any remaining questions. If these additions address your concerns, we would be grateful if you could reconsider your assessment.
Response to Reviewer JxrA
Thank you for the constructive comments. We provide additional experiments and analyses addressing fractional-time accuracy, baseline comparability, decoder design, and rapid changes.
1. Learned baselines and dense queries (W2/Q1/Q2). We retain the paper's RTMA-RU setup and extend queries to 0.25, 0.50, and 0.75 h within each hour. Metrics and units follow the paper.
Grouped by query position within each hour, T2m / wind vector MAEs are:
PSAF has lower errors on all four overall metrics and both reported metrics at each query position, extending the evidence beyond hourly midpoints.
2. Training data and input resolution (W1/Q3). WeatherBench v1 and WeatherBench 2 both derive from ERA5. Direct any-time forecasting of global multivariate weather fields remains relatively underexplored at finer spatial resolutions, and PSAF demonstrates this capability at 1.5-degree resolution, complementing existing research on continuous-time weather forecasting.
Adapting ClimODE and CEF to this resolution and retraining them under matched conditions requires additional time and computational resources. We apologize that, given the time and resources available, we have not yet completed this comparison.
The added ModAFNO, AMT and UPR-Net comparisons use the same WB2 data source, 1.5-degree grid and 2006–2015 integer training labels as PSAF Stage 2, and share the same 6h forecast endpoint. These comparisons further evaluate PSAF's predictive performance under the same data and resolution settings.
3. Local Decoder MoE versus a shared decoder (Q4). The paper's shared decoder receives time conditioning through the queried latent state. Removing Local Decoder MoE increases 1h RMSE by 10.8% and yields higher errors at 1–5h. The additional fractional RTMA-RU results are:
These results support Local Decoder MoE at both integer and fractional leads. The existing shared decoder does not match the experts' total parameter count. We will prioritize a parameter-matched, time-conditioned shared decoder comparison as compute becomes available, to separate the contributions of local experts and model capacity.
4. Rapid changes and Physics Surrogate Supervision (Q5). Linear interpolation of physical diagnostic targets provides approximate supervision. Full fields are learned jointly through integer full-field supervision, Physics Surrogate Supervision and Continuity Regularization.
We select 15-minute temperature or wind vector changes at or above each grid point's P95 threshold in RTMA truth. PSAF's change-MAE reductions against the four baselines are:
PSAF has the lowest change MAE for both temperature and wind vector on these rapid-change subsets.
5. Recursive composition consistency (additional comment). PSAF constructs each forecast from the supplied history and query time. A direct 1h query uses the original history, whereas two successive 0.5h steps use generated states to form the second query's history. This changes the conditioning context and carries forward prediction errors, so the recursive procedure does not inherit the composition property of an exact ODE flow. The appendix reports normalized forecast MAEs of 0.01578 and 0.02043, respectively.
We will incorporate these additional results and the corresponding experimental settings and clarifications into the revised manuscript shortly.