- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This submission addresses the data assimilation problem for weather forecasting. The authors propose Rolling Diffusion Data Assimilation (RDA), a new method based on rolling diffusion models that denoises a sequence of states with sequential noise levels. The authors argue that current methods fail to properly account for the uncertainty of past states and propose addressing this via rolling diffusion: a sampling algorithm that regenerates past states based on their posterior distribution. The method is evaluated on Lorenz 63, surface quasigeostrophic dynamics, and ERA5, demonstrating superior posterior sampling abilities over the baselines. The authors also present several ablations to assess the effect of different hyperparameters.
Critical strengths
The method is evaluated on several dynamical systems of increasing complexity. The Lorenz 63 evaluation helps visualize and understand the method, the ERA5 dataset serves as the targeted real-world application, and the surface quasigeostrophic dynamics model offers appropriate intermediate complexity.
The experiments demonstrate that the proposed method improves performance over all compared baselines when evaluated on suitable probabilistic metrics.
Critical weaknesses
The exposition of the method is fairly complex and difficult to follow overall due to heavy notation. Furthermore, the paper provides little intuition regarding the fundamental limitation identified by the authors and how the proposed solution resolves it.
1. Novelty
1.1 The method's novelty is not adequately discussed relative to recent diffusion-based and diffusion-forcing methods. In the methodology section, the authors first present rolling diffusion, an established technique, and then present a straightforward extension to account for observations in Section 3.2. As presented, the paper's primary contribution relies on the editable history framework presented in Section 3.2 to bridge a theoretical gap. To convincingly demonstrate the impact of this technique over a simpler adaptation of rolling diffusion, the effect of editing history should be explicitly evaluated and discussed. However, this comparison is barely studied in the experiments.
1.2 The core limitation identified by the authors is also not clearly illustrated. If this theoretical gap is indeed a primary drawback of prior work, a concrete example should demonstrate what a data assimilation method fails to capture when it does not model the smoothing distribution. Instead, the paper only reports benchmark tables with aggregated metrics.
1.3 In the introduction, the authors highlight the high memory and inference costs of score-based data assimilation and claim that RDA addresses this issue. However, it remains unclear from the text how RDA achieves these computational savings.
2. Empirical validation
2.1 I have concerns regarding the choice of baselines. In both the surface quasigeostrophic system and ERA5 experiments, RDA is compared only against another deep generative model. It should be benchmarked against operational state-of-the-art baselines like 4D-Var or the Ensemble Kalman Filter (EnKF). Without these standard baselines, the evaluation relies entirely on neural-network-based methods and their specific training setups, making the claims less convincing.
2.2 Furthermore, while the authors discuss theoretical differences between RDA and other diffusion-based data assimilation methods, these alternative diffusion baselines are not evaluated on the ERA5 dataset. Consequently, RDA is compared against only a single deep learning baseline on ERA5.
2.3 Finally, the motivation for using quadratic or tanh observation operators is unclear. The physical motivation for these observation processes should be explicitly justified.
3. Relevance of the theoretical guarantee
The theoretical analysis assumes exact Bayesian conditional updates (Theorem 2). However, diffusion posterior sampling algorithms provably yield a biased posterior, even in the Gaussian case [1]. Consequently, the applicability and usefulness of this theoretical result are unclear, providing little practical intuition for the proposed method.
References
[1] Hodyss, D., & Morzfeld, M. (2026). Using diffusion models to do data assimilation. Monthly Weather Review, 154(2), 165-182.
Questions for authors
1. Since the history of past states is editable and variable in the proposed framework, how is temporal consistency between consecutive reconstructed states ensured?
2. What is the underlying backbone generative architecture, and how is it trained?
3. What is the proposed method's computational cost in terms of memory consumption and the number of neural network evaluations, and how does it compare quantitatively to previous generative data assimilation methods?