- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose UniGIO, a small conditional VAE for global weather-station data interpolation and forecasting. Forecasting, imputation and station/variable generation are framed as a mask-conditioned completion problem. Its main components are an Observation Mixer (variable attention, station graph attention and a latent field grid) and an Adaptive Temporal Mixer (reliability-weighted bidirectional Mamba + a geography-aware mixture-of-experts). The authors test their approach on Weather-5K and reports strong gains in accuracy. They compare to generative, station-forecasting and foundation-model baselines and include a comparison to raw HRES, an operational ECMRWF product.
Critical strengths
I want to highlight the following strengths of the submission
- Overall, the paper is pretty well written and easy to follow; the methodology is outlined comprehensively (though sometimes lacking a bit of detail).
- The problem this submission tackles is obviously highly relevant. AI for climate and weather modeling is becoming increasingly important with accelerating climate change.
- The idea of disentangling (global) regular time series forecasting from (local) extreme event modeling is very interesting and intuitively a valuable thing to try out. It's both well motivated practically and an interesting approach methodologically.
Critical weaknesses
The submission has the following shortcomings, ordered roughly from, in my opinions, most to least severe:
- There's an overall lack of contextualization with existing work in sparse / masked spatio-temporal modeling. Application wise, there's so much related work on sparse and continuous spatio-temporal observations from which the goal is to obtain a (dense) map and to forecast; from remote sensing to ecology. The paper could benefit from a related work section to place its contributions within existing work beyond just AI for weather and climate. Methods wise, I feel like several important baselines are missing in the experiments. From simple interpolation baselines to discrete models (temporal MAEs etc.) and continuous models (Gaussian Processes, location encoders, neural processes,...so much work focused on exactly this problem!). Furthermore, there's a whole area of literature focused on spatio-temporal sensor networks [1,2,3]. Why is there no comparison to any of these methods arguably in the same area?
- The claim that UniGIO "outperforms operational HRES" seems overstated, given that is not the case for wind direction and sea-level pressure.
- There are no error bars / standard errors given thoughout the work.
- If I understand correctly, extreme events are simulated by sampling (and masking) random stations; this seems a bit simplistic when actually known locations / areas that exhibit regular extreme events could be chosen for masking?
- The figures in the paper are illegible (way too small); you have to zoom in a lot in order to be able to see details. If you're printing out the paper to read it you could simply not understand the figures. They are also way too overcrowded, so that they don't actually act as a valuable visual helper to get key messages across. Figures should be heavily simplified and reworked with a focus on legibility.
- Am I missing something or is space modeled twice? The field-former + the graph network. If so, why is it modelled twice? And what is the effect of each of the components?
References:
[1] Cini, Andrea, Ivan Marisca, and Cesare Alippi. "Filling the g_ap_s: Multivariate time series imputation by graph neural networks." ICLR 2022
[2] Wu, Yuankai, et al. "Inductive graph neural networks for spatiotemporal kriging." AAAI 2021
[3] Liu, Mingzhe, et al. "Pristi: A conditional diffusion framework for spatiotemporal imputation." ICDE 2023
Questions for authors
Please see comments above for questions; specifically, please share your thoughts on my perceived lack of baseline comparisons + the questions on extreme event simulation and double space modeling.
8 comments
Response to Reviewer 1aoC (Weaknesses 2/6): Clarification of the HRES Comparison
Response: Clarification of the HRES Comparison
Thank you for pointing this out. We have revised the original statement to explicitly specify the variables for which UniGIO achieves lower forecasting errors than operational HRES.
Revision note: Major revisions are highlighted in blue in the revised manuscript. We have revised the corresponding statement in the main text (Lines 417–419) to clarify the scope of this comparison.
Revised text:
It also outperforms the observation and time-series foundation models ESFM and Chronos2 on most evaluated metrics, while achieving lower forecasting errors than operational HRES for temperature, dewpoint, and wind rate.
Response to Reviewer 1aoC (Weaknesses 3/6): Statistical Variability and Error Bars
Response: Statistical Variability and Error Bars
Thank you for pointing this out. We agree that reporting statistical variability is important for assessing the reliability of our results.
Revision note: Major revisions are highlighted in blue in the revised manuscript. We have added a new subsection, Inference Stability, in Appendix H.3 of the revised manuscript, including error-bar visualizations in Fig. H.1 and detailed numerical results in Table H.3.
Specifically, we repeat the evaluation with five different inference seeds for each method, while keeping the trained checkpoints, test split, mask settings, and other evaluation parameters fixed. We report the mean and sample standard deviation (SD) for MAE, MSE, and SEDI.
The results show that UniGIO exhibits consistently low inference variability, with small variations in MAE and SEDI across the five seeds. The model rankings also remain consistent with the reported comparisons. These findings support the stability of our conclusions with respect to inference randomness.
Response to Reviewer 1aoC (Weakness 1/6): Related Work and Additional Spatiotemporal Baselines
Response: Related Work and Additional Spatiotemporal Baselines
Revision note: Major revisions are highlighted in blue in the revised manuscript. Newly added baseline methods are highlighted in blue in the revised manuscript, including Tables 1–4 and Appendix Tables F.1–F.3. The corresponding experimental analysis is provided in the main text (Lines 366–372). The expanded Related Work is provided in Appendix A.2 and A.4.
Thank you for this valuable suggestion. We have substantially expanded the Related Work and strengthened the experimental comparisons to systematically address the methodological categories highlighted by the reviewer. These additions provide a broader context for positioning UniGIO and further clarify its distinctive advantages in global in-situ observation (GIO) modeling.
1. Expanded Related Work. We have extended our discussion to cover sparse and masked spatiotemporal learning, including classical interpolation and Gaussian Processes, discrete station-based modeling and masked autoencoders, continuous spatial modeling and neural processes, graph-based spatiotemporal sensor networks, and generative imputation. We further discuss representative methods such as Kriging, location encoders, GRIN, SPIN, and IGNNK. These additions establish clearer connections to the broader literature and distinguish the general objectives of sparse spatiotemporal reconstruction from the specific requirements of GIO modeling.
2. Additional Baseline Comparisons. Following the reviewer's suggestion, we have incorporated recent representative advances in the methodological directions highlighted by the reviewer, alongside classical approaches:
These comparisons cover the methodological families identified by the reviewer while incorporating recent representative advances. The updated results show that UniGIO achieves the best MAE/MSE across all 20 variable–metric–mask combinations at 120h and the best F1-SEDI in 15 of 16 extreme-event comparisons, demonstrating consistent advantages across these diverse approaches.
More importantly, the additional baselines reveal a common weakness in extreme-event reconstruction. Under curated masks at the 99.5th percentile, their F1-SEDI scores range from only 0.05–0.14 for temperature, 0.01–0.06 for wind speed, and 0.01–0.12 for sea-level pressure, compared with 0.55, 0.22, and 0.79 for UniGIO, respectively. These results suggest that generic spatiotemporal modeling does not necessarily capture the localized abrupt extremes characteristic of weather observations, even when it effectively models broader spatiotemporal dependencies.
3. Distinction from Existing Sparse Spatiotemporal Modeling. Unlike approaches primarily designed for individual tasks such as interpolation, reconstruction, or imputation, UniGIO unifies forecasting, imputation, and generation from severely incomplete station observations. Beyond task unification, GIO modeling must address the mismatch between discrete station observations and continuous weather processes, as well as the coexistence of smooth temporal evolution and localized abrupt extremes.
Accordingly, UniGIO combines discrete station interactions with continuous local-field representations to integrate fragmented evidence across space and time, while evolution–extreme decoupling preserves stable temporal dynamics and enables adaptation to localized extremes. These complementary mechanisms distinguish UniGIO from existing task-specific spatiotemporal modeling approaches.
We believe the expanded literature coverage, additional baselines, and corresponding experimental analysis substantially address the reviewer's concerns and more clearly establish UniGIO's contributions to sparse spatiotemporal modeling.