- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GeoDes, a generative model that generates the evolution of Location-Sparse Phenomena (LSP) conditioned on an initial observation. The proposed approach decouples the 2D spatial training and 3D spatial-temporal training, bridged by temporal inflation for model parameter compatibility. Temporaly correlated noises are used in the diffusion forward process of 3D spatial-temporal training. Experiments cover extratropical cyclone synthesis and post-disaster satellite image synthesis.
Critical strengths
- GeoDES achieves lower peak vorticity error than the evaluated baselines and near-ideal high-frequency spectral ratio and frequency bias scores on cyclone synthesis.
- Clear organization of the evaluation section. Section 3 explicitly identifies four claims and evaluates them through corresponding experiments. This structure makes the supporting evidence easy to locate and read.
Critical weaknesses
-
The task formulation is not clear in the introduction section. By just reading section 1, I actually cannot get what exact task the model addresses or how the problem relates to real life application. For example is it about weather forecasting? or scenario synthesis for data augmentations? Simply saying 'modeling LSP' is vague to people unfamiliar to this field like me. I think the authors could mention and explain the task a bit at the beginning of section 1.
-
The methodology rationale is not clear. The introduction section emphasizes the sparisty issue of LSP. However, it is unclear how the proposed components in GeoDes specifically address the sparsity issue.
-
For the change modeling task, GeoDes's prediction looks still far from the target frame. And the FIDs are also high. GeoDes has highest standard deviation here. In fact, is this result considered useful for the post-disaster prediction task?
-
Several ablated variants still outperform many baselines on some metrics. This may indicate that the overall gains are due to the neural network architecture, parameter count, or even training hyperparameters, More controlled comparisons would help clarify this.
Questions for authors
- What are the \pm numbers in table 1? Are they the standard deviations across the runs? What varies between runs, the training seeds?
- Why only averaged across 2 runs in table 2? I expect the standard deviations (if they are) are not reliable in such case.
- What does 'sampling paradigm=storm' mean in table 3?
- Missing ablation - the use of correlated noise in the diffusion forward process of the 3D model.
We thank the AC and the reviewers for their time and attention to GeoDES. We believe that GeoDES is an important step towards generating fine grained structures in geospatial phenomena and showcasing the severe inadequacies of preexisting approaches, such as weather foundation models, for this purpose. While we are grateful for the feedback we have received, we are withdrawing the manuscript and intend to revise according to reviewer feedback in the future.