- Rating
- 2(−1)
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies an important problem of data assimilation in numerical weather prediction. The authors propose StreamDA, a recurrent spatio-temporal modeling for hourly global data assimilation, featuring memory-based temporal fusion and coverage modulation. Generally, this paper is well-written and easy to follow. The method is technically sound. In addition, experiments show the effectiveness of the proposals.
Critical strengths
- This paper is well-written and easy to follow. The structure is clear.
- A recurrent spatio-temporal modeling framework is proposed for hourly global data assimilation in numerical weather prediction, consisting of memory-based temporal fusion, coverage modulation, and observation fusion. Extensive experiments show the effectiveness of the proposals.
Critical weaknesses
- Although data assimilation is very important in numerical weather prediction, many new researchers may not know it clearly and may not know why it is important. It would be better to include more background at the beginning of the abstract and introduction.
- Efficiency plays an important role in weather prediction. It is suggested to include a comparison of the efficiency, i.e., training time, inference time, FLOPs, and memory usage, of the baselines and the proposed StreamDA. It would be better to include more baselines as follows.
[1]. Climate model configurations of the ECMWF Integrated Forecasting System (ECMWF-IFS cycle 43r1) for HighResMIP, Geoscientific model development 2018.
[2]. Learning skillful medium-range global weather forecasting, Science 2023.
[3]. Accurate medium-range global weather forecasting with 3D neural networks, Nature 2023.
[4]. Scaling transformer neural networks for skillful and reliable medium-range weather forecasting, NeurIPS 2024.
Questions for authors
Please see the weaknesses.
9 comments
Thanks for the response. However, it is not enough to only compare StreamDA with HealDA. It is required to show the comparisons between StreamDA and all baselines.
Response to Reviewer bSWX
Dear Reviewer bSWX,
Thank you for your further feedback. Following your suggestion, we have added FuXi-Weather to the comparison. We now report the computational costs of StreamDA, HealDA, and FuXi-Weather, as well as the accuracy of downstream forecasts initialized from their analysis fields.
1. Computational efficiency (Appendix B.3, Table 6)
The table below compares the training and inference costs of the three assimilation methods. StreamDA requires the fewest FLOPs per analysis and the least peak inference memory.
| Metric | StreamDA | HealDA | FuXi-Weather |
|---|---|---|---|
| Inference time (s/analysis) | 0.327 | 0.550 | 0.594 |
| FLOPs (TFLOP/analysis) | 6.48 | 23.393 | 9.130 |
| Peak inference memory (GiB) | 2.38 | 8.69 | 5.59 |
| Training time (hours) | 63.32 | ~200 | ~80 |
| Training cost (GPU-hours) | 253.28 | ~1,600 | ~320 |
| Training hardware | 4 × H800 | 8 × H100 | 4 × A100 |
2. Downstream forecasts (Appendix B.2, Figures 7–8)
We initialized Pangu-Weather, Aurora, and Stormer with analysis fields from each of the three assimilation methods. For each forecast model, we compared all three initializations at the same forecast start times. The table below reports the mean relative increase in forecast RMSE (%) compared with ERA5 initialization. Lower values are better.
| Forecast model | Initialization | Day 1 | Day 3 | Day 5 | Day 7 | Day 10 |
|---|---|---|---|---|---|---|
| Pangu-Weather | StreamDA | 32.57 | 17.61 | 11.79 | 7.79 | 4.13 |
| HealDA | 53.48 | 25.70 | 16.03 | 10.20 | 5.11 | |
| FuXi-Weather | 63.77 | 39.37 | 27.00 | 17.31 | 8.09 | |
| Aurora | StreamDA | 36.80 | 15.03 | 9.72 | 6.20 | 2.80 |
| HealDA | 54.88 | 21.62 | 13.24 | 8.55 | 3.94 | |
| FuXi-Weather | 67.60 | 31.92 | 20.90 | 13.18 | 5.84 | |
| Stormer | StreamDA | 27.83 | 13.61 | 9.09 | 6.29 | 3.71 |
| HealDA | 50.56 | 22.45 | 13.67 | 9.00 | 5.39 | |
| FuXi-Weather | 65.75 | 38.23 | 26.85 | 18.73 | 11.22 |
We have incorporated these comparisons into the revised manuscript. Thank you again for helping us improve the paper.
Best regards,
The Authors
Response to Reviewer bSWX
We thank the reviewer for the positive assessment and constructive suggestions. We have revised the Abstract and Introduction to more clearly explain the role and importance of data assimilation in numerical weather prediction.
We have also expanded the computational efficiency comparisons. StreamDA shows advantages in peak inference memory usage (GiB), computational cost per analysis (TFLOPs), forward-pass time per analysis (seconds), and training cost (GPU-hours). Detailed results and measurement settings are provided below.
Q1. Background on data assimilation
Thank you for your suggestion. We have added background on data assimilation at the beginning of the Abstract and Introduction. We explain how it combines observations with a background field to produce an analysis field for forecast initialization, and why analysis quality matters for forecast performance. We also describe the alternating assimilation and forecast cycle, along with the computational cost and update-frequency limitations of traditional assimilation methods. These additions help readers unfamiliar with the field understand the motivation for our work.
Q2. Computational efficiency and baselines
Thank you for your suggestion. We have added a comparison of the training and inference costs of StreamDA and HealDA. The first table reports training time, inference time, FLOPs, peak inference memory, GPU-hours, and hardware configurations. StreamDA requires less inference time, computation, and peak GPU memory. This difference partly stems from how the two methods process historical observations. HealDA processes the full observation window at each analysis step, repeatedly encoding observations shared by adjacent windows. StreamDA retains historical information through recurrent states and memory and incorporates new observations at each update. This reduces repeated processing and helps lower the cost of continuous assimilation.
We have also added downstream forecast evaluations with Aurora and Stormer alongside Pangu-Weather. The second table reports the mean relative RMSE increase compared with ERA5-initialized forecasts, with equal weight given to all 69 variables. For all three forecast models, StreamDA initialization gives a smaller gap to the ERA5-initialized reference than HealDA* initialization. These results further demonstrate StreamDA's applicability across different forecast models.