- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This manuscript proposed a simple but effective method to modify the backend of foundation model Aurora to achieve weather downscaling.
Critical strengths
The paper is written reasonably well. The method appears to be simple. Comprehensive evaluations are included in the manuscription.
Critical weaknesses
There could be a persistent distribution shift between Aurora (which is mainly trained by ERA5) and HRRR. The proposed method appears to be using the fine-tuned head to correct the bias. A question is if the distribution shift can't be corrected by the fine-tuned head.
Questions for authors
- How is HadISD data used for fine-tuning since they are not on the grid? The paper discussed the regridding of HRRR and DANR data, but not HadISD
- Table 1, > $ 1 ^\circ C$ RMSE for T2 is still substantial. Any reason why?
- Again in Table 1, the table only listed the RMS of and , what are the percentage RMSE?
- Do numerical results for HRRR cover the whole CONUS?
2 comments
Thanks for the additional comments. I will take them into consideration when I revise my reviews.
We thank the reviewer for the time and effort devoted to reviewing and evaluating our work.
W1
Our decoder heads adapt Aurora’s frozen representations to HRRR targets, which can include correcting systematic differences between datasets. To test whether the accuracy gains also constitute useful fine-scale spatial variation, we performed two complementary comparisons.
Both coarse representations have similar RMSEs and are outperformed by our full model across all surface variables. RMSE reductions vs. HRRR-biased MLP-4-2 are 17.2% (2 m temperature), 10.1% (10 m u-wind), 8.3% (10 m v-wind), and 3.0% (MSLP). Thus fine-scale prediction adds non-negligible skill beyond coarse bias correction, especially for temperature/wind; the smaller MSLP gain is consistent with its smoother spatial structure.
These results support the predictive value of sub-0.25° spatial variation beyond the tested coarse correction.
Q1
HadISD is used exclusively for evaluation, not for fine-tuning. This is explicitly stated in Section 3 (Data) of the paper.
Since HadISD consists of station-based observations rather than gridded fields, no regridding is performed. For evaluation, station observations are compared with model predictions at the nearest 0.025° grid point. When multiple stations map to the same grid cell, their observations are averaged for intensive variables, as described in Appendix B.4.
Q2
At +6 h, Table 2 reports 1.1743°C for our nearest-neighbor configuration and 1.1749°C for WRF-ARW, both evaluated against the same HRRR analyses under the same protocol. The approximately 1.18°C error therefore represents temperature accuracy comparable to the operational NWP baseline in this evaluation.
The 2022 per-gridpoint RMSE map,
rebuttal-outputs/average-rmse-t2m-2022.png(available in our anonymous repository), shows higher errors over mountainous terrain and around the Great Lakes. In mountainous regions, steep elevation gradients can produce sharp local temperature variations over short distances. Accurately predicting these variations remains challenging even at our 0.025° output grid spacing, nominally about 2.7 km. Around the Great Lakes, strong land–water thermal contrasts provide another plausible source of locally complex temperature patterns.Q3
Below we present percentage RMSE errors calculated in two different ways:
As can be seen below, for both metrics, our model still outperforms WRF-ARW NWP system.
The reference mean wind speed and component standard deviations are calculated from HRRR analyses over all timestamps in 2022. The same reference statistics are used for both models.
Q4
No, the main HRRR-grid results do not cover the whole geographical CONUS. Since HRRR is natively defined on a Lambert Conformal Conic (LCC) projection, we regrid it onto a regular latitude–longitude grid aligned with the IFS HRES coordinate system (Section 3.2). The exact extents of CONUS evaluation domain are:
No US-boundary or land-only mask is applied.