- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents score-based DA approach for multi-sourced weather analysis. The method combines an error-correcting unified latent representation (over states and observations) with a gradient-conflict approach (from multi-task learning) for improved guidance.
Critical strengths
-
The multi-source setup of DA is very practical, so the need for a method that deals with this setup is important.
-
The experimental results with the recent diffusion model approach show improvements in terms of both run-time (Table 2) and the problem-specific metrics (Table 1).
-
Other results demonstrate the impact of every component of RISDA.
Critical weaknesses
Weaknesses/Questions/ Suggestions:
-
Minor: The main target of the paper is multi-source but the acronym RISDA does not account for that.
-
If the multi-source setup in Sec 3.1.2 is in preliminaries, then can authors cite which previous methods have dealt with this?
-
In equation 4, shouldn't the guidance terms be weighted?
-
For training the O2L operator, why do you use the ERA-5-pretrained decoder? This seems to be ad-hoc.
-
What is MMPS?
-
Why there needs to be mask in O2L of Sec 3.2.1?
-
Set \Omega is unnecessarily defined twice.
-
What is MHS?
-
Italic and non-Italic font is used for R^i.
-
Equations 8 and 11 have very strange super script on the left of s.
-
Major: The paper is very empirical (which is fine). Therefore, there needs to be an empirical support of why one would purse score-based methods and not others. Therefore, comparison with an ML-based supervised method and a non-ML method (e.g., numberical methods) is needed. If compute and time are not available for standard numerical methods, then the authors could at least share their results and compare even if the compute HW is not the same. For non-weather-analysis audiance, this would be valuable.
-
Missing recent literature such as [A,B]
[A] ForcingDAS: Unified and Robust Data Assimilation via Diffusion Forcing, ICML 2026 FoGen Workshop
[B] FlowDAS: A Stochastic Interpolant-based Framework for Data Assimilation, NeurIPS 2025
Questions for authors
See Weaknesses.
6 comments
Extension of Baseline Comparisons (Weakness 10):
We thank the reviewer for this constructive suggestion. Below, we clarify our motivation for pursuing the score-based paradigm over classical numerical and deterministic supervised ML methods, as well as the practical constraints and experimental scope of our study: Traditional variational and ensemble frameworks (e.g., 4D-Var, EnKF) require solving full-physics atmospheric dynamical equations and tangent-linear/adjoint models, incurring prohibitive computational costs and long run-times. Meanwhile, while deterministic supervised ML DA models (e.g., Aardvark Weather, FuXi-Weather) achieve fast inference via direct input-to-target regression, they suffer from architectural rigidity—adding, removing, or modifying observation instruments requires retraining the entire large backbone network. In contrast, RISDA-M enables fast posterior sampling alongside plug-and-play modularity, allowing new observation streams to be integrated via lightweight observation encoders without retraining the prior diffusion backbone (see related work). Operational numerical weather prediction (NWP) systems assimilate orders of magnitude more global observations than the restricted satellite subset used in our controlled study. Therefore, direct accuracy comparisons against operational numerical analysis fields are unfair. Furthermore, classical numerical methods (such as 4D-Var) require high-vertical-resolution atmospheric states to run physical radiative transfer models (e.g., RTTOV) for satellite radiance assimilation, whereas our compact 13-pressure-level representation cannot natively interface with these physical observation operators. Indeed, precisely due to the lack of differentiable physical operators in compact neural state spaces, existing score-based DA literature has largely focused on synthetic or direct in-situ observations (where observation operators are trivial or unnecessary), leaving real-world satellite radiance assimilation unaddressed. Our study represents the exploration of real-world multi-source satellite radiance assimilation within the score-based DA paradigm. Accordingly, our experiments follow the standard protocols of the generative DA community and focus on evaluating the effectiveness of our framework against representative score-based DA baselines under identical real-world multi-source observation settings.
To broaden the comparison within generative assimilation, we implement an adapted LO-SDA baseline by augmenting our existing Appa implementation with a latent optimization stage at every diffusion sampling timestep. The adapted baseline uses the same L2O observation operators and observation inputs as Appa, with all other experimental settings kept unchanged. The results are reported in Table 1.
Table 1. RMSE (↓) comparison including the adapted LO-SDA baseline, using all six observation sources over April–June 2025 and ERA5 as the reference. For Z, R, T, U, and V, values are listed in the order 300/500/850 hPa. T2M, U10, V10, and MSL are surface variables.
| Method | Z | R | T | U | V | T2M | U10 | V10 | MSL |
|---|---|---|---|---|---|---|---|---|---|
| LO-SDA | 291.26/213.88/162.38 | 21.13/18.65/18.48 | 1.59/1.50/1.77 | 6.46/4.63/3.27 | 6.01/4.29/3.02 | 1.25 | 2.07 | 2.02 | 212.66 |
| Appa | 290.68/213.45/162.22 | 21.14/18.66/18.49 | 1.59/1.50/1.77 | 6.46/4.63/3.27 | 6.01/4.29/3.02 | 1.25 | 2.07 | 2.02 | 212.64 |
| AGF | 194.27/163.40/140.73 | 20.61/20.44/14.37 | 1.27/0.99/1.29 | 3.91/3.05/2.31 | 3.79/2.91/2.20 | 1.26 | 1.36 | 1.38 | 184.90 |
| PPGF | 170.41/145.85/133.77 | 17.67/15.53/13.49 | 1.15/0.93/1.24 | 3.75/2.94/2.25 | 3.63/2.81/2.15 | 1.20 | 1.35 | 1.37 | 178.48 |
The adapted LO-SDA baseline performs comparably to Appa under this observation setting, while PPGF+VCLG achieves lower RMSE than both methods across all 19 reported variables. This additional comparison supports the effectiveness of RISDA for joint generative assimilation of real-world heterogeneous observations.
Missing Recent Literature (Weakness 11):
We thank the reviewer for pointing out these relevant recent works. We have added citations of both ForcingDAS and FlowDAS in the Introduction of the revised manuscript.
Summary Response
We sincerely thank the reviewer for the detailed and constructive feedback. We are encouraged by the reviewer’s recognition of the importance of addressing real-world multi-source data assimilation, the demonstrated improvements in analysis accuracy and inference efficiency, and the ablation studies showing the contributions of the individual components of our framework.
The reviewer’s main concerns relate to the clarity of the multi-source formulation and observation-guidance design, the scope of baseline comparisons, missing related work, and manuscript presentation. We have clarified the methodological choices underlying our guidance framework, added references for prior multi-source score-based assimilation, and explained our motivation and experimental scope. We have also supplemented the comparison with an adapted LO-SDA baseline, incorporated the suggested recent literature, and revised the acronym, terminology, and mathematical notation. We hope these clarifications, revisions, and additional results address the reviewer’s concerns and improve the clarity and completeness of the manuscript.
We sincerely thank the reviewer for the insightful, detailed, and constructive feedback. We are greatly encouraged by the reviewer's recognition of our practical problem formulation ("...deals with this setup is important"), strong empirical performance and efficiency ("...show improvements in terms of both run-time (Table 2) and the problem-specific metrics (Table 1)"), and thorough ablation validation ("Other results demonstrate the impact of every component of RISDA"). We appreciate the critical suggestions regarding manuscript presentation and notation, the training of the O2L operator, baseline comparisons, and missing recent literature. We have carefully checked and revised the manuscript accordingly, and provide a detailed point-by-point response below.
Acronym and Title Issue (Weakness 1):
We have updated the acronym to RISDA-M throughout the title and manuscript to explicitly reflect the multi-source setting.
Preliminaries for Multi-Source Observations (Weakness 2):
Thank you for pointing this out. We have added relevant citations in Section 3.1.2 referencing established multi-source data assimilation.
Gradient Weighting in Equation 4 (Weakness 3):
Equation 4 adds the source-wise likelihood gradients without additional manually chosen scalar weights. Each gradient already accounts for source-specific uncertainty through the Gaussian likelihood in Equation 2, whose covariance incorporates the corresponding observation-error covariance together with the uncertainty in estimating the clean state from the noisy latent. Thus, differences in observation uncertainty are already reflected in the individual guidance terms.
Rationale for the ERA5-Pretrained Decoder in O2L Training (Weakness 3):
We use the frozen ERA5-pretrained atmospheric decoder as a common reference for training the source-specific observation encoders. The atmospheric prior is learned in the latent space of the pretrained atmospheric autoencoder. During O2L training, each observation encoder is optimized through this fixed decoder to reconstruct the corresponding ERA5 atmospheric variables. This reconstruction objective encourages the observation representations to be compatible with the pretrained atmospheric representation, providing implicit alignment through supervision in physical space. Keeping the decoder fixed ensures that the observation encoders adapt to a shared reconstruction mapping, rather than allowing each source to change that mapping during training. This design connects heterogeneous observations to the existing atmospheric representation and provides a common basis for subsequent latent-error calibration and observation guidance.
Definition of MMPS (Weakness 4):
We have added the full name—Moment Matching Posterior Sampling (Rozet et al., 2024; Andry et al., 2025)—upon its first occurrence in the manuscript.
Necessity of Masks in O2L in Section 3.2.1 (Weakness 5):
Polar-orbiting meteorological satellites scan the Earth along narrow orbital swaths, leaving vast geographic regions without valid observations within a short time window. While deep learning encoders are capable of extrapolating or "guessing" values for unobserved regions, such extrapolations carry high uncertainty and potential hallucinations. If left unmasked, these uncertain imputed values could generate spurious likelihood gradients, injecting false guidance signals into the latent space and degrading overall sampling accuracy. Therefore, spatial masks are strictly applied to restrict guidance signals exclusively to genuinely observed locations.
Redundant Definition of Set Omega (Weakness 6):
We have removed the second, redundant definition of \Omega in the revised manuscript.
Definition of MHS (Weakness 7):
We have added full names upon first appearance for all instrument acronyms throughout the text and included a reference (Eyre et al., 2022) for further background.
Font Consistency for R^i (Weakness 8):
We have carefully checked the entire manuscript and standardized the font formatting of R^i for consistency.
Left-Superscript Notation in Equations 8 and 11 (Weakness 9):
We have moved the superscript to the upper right position in Equations 8 and 11 to follow standard mathematical notation.