- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Neural Conditional Simulation (NCS), a framework for refining coarse PDE solutions into high-resolution stochastic fields. It combines classical Gaussian conditional simulation with a learned nonlinear innovation to capture structures that Gaussian assumptions cannot represent. The method uses a coarse-to-fine cascade with one network evaluation per level. Experiments on stochastic Allen–Cahn, Navier-Stokes, and GARD-LENS precipitation demonstrate competitive accuracy, uncertainty calibration, and spectral properties compared with diffusion models, at substantially lower inference cost.
Critical strengths
Building on classical kriging and Gaussian conditional simulation is a well-motivated approach. Rather than learning the entire conditional distribution from scratch, the method learns the correction to an existing statistical model. The Gaussian simulator provides a meaningful baseline, making it possible to assess what the neural network actually contributes. I find this particularly interesting. The evaluation covers several stochastic systems and compares against classical methods, neural operators, and diffusion models. The authors examine CRPS, energy score, ensemble spread, spectral properties, and extreme statistics. The results are encouraging, particularly the ability to obtain competitive probabilistic performance with substantially fewer network evaluations. The controlled experiments investigating where the Gaussian assumptions fail also strengthen the contribution.
Critical weaknesses
Although NCS achieves good overall calibration, the standard energy-score model substantially underestimates the heavy-tailed increment statistics on GARD-LENS, with a kurtosis ratio of 0.17. The authors address this using an amplitude-conditional objective, which is encouraging, but it shows that the standard formulation does not fully capture important extremes. Since these are particularly relevant for precipitation applications, this limitation deserves more emphasis. Can you please elaborate this? It would be nice addition to the paper. Maybe in the camera ready version add this.
Questions for authors
-
The amplitude-conditional objective substantially improves the precipitation tails. Would you recommend this as the default NCS formulation for strongly non-Gaussian fields? How does its CRPS compare with the original NCS model?
-
Could you clarify how the common coarse conditioning is constructed from the GARD-LENS ensemble members? How sensitive might the approach be to biases in independently generated coarse-resolution inputs?
3 comments
Part 2/2
Q2: How is the common coarse condition built? Sensitivity to bias in independently generated coarse inputs?
We will describe it more precisely in Appendix D.1. For each day, the condition is the ensemble mean of the high-resolution members, block-averaged by (). The same condition is used for all members and by every method. Data are split by day, so no test day is seen during training. Two consequences, which we will state in Sec. 4, Appendix D.1 and the limitations:
- The condition is shared across members, so all between-member variability must be generated by the model. The task is therefore conditional reconstruction given a consistent coarse field.
- Robustness to coarse-model bias is untested on GARD-LENS, because the dataset has no independently produced coarse field. On our synthetic test cases, the coarse condition is a separate noise-free solve on the coarse grid, not a coarsening of the fine members, so those results already exercise an independent coarse solve.
As a controlled sensitivity test we offer a condition-member mismatch sweep on Navier-Stokes. Our Navier-Stokes simulator allows us to set how far the members' large scales drift from the condition. We sweep it from the training value () through weaker settings () to fully free, and add one setting that is similar to GARD-LENS. All settings share the same random seeds, so the conditions are identical across settings. The members differ in their large scales and, slightly, in their fine-scale statistics; in particular, power in the finest resolved band is up to about 15% higher when free. We take the models trained on the current dataset and evaluate them, without retraining, on every setting. This measures how a deployed model responds to a coarse input that does not match the members it was trained against. The mismatch is the relative distance between each member's coarsened large scales and the test conditions, which gives the sweep a model-independent axis.
ES (mean over 3 seeds; in parentheses)
| Setting | NCS | CorrDiff | EDM | Consistency | GCS | PNO | |
|---|---|---|---|---|---|---|---|
| GARD-style | 0.14 | 310.8 (0.98) | 309.0 (1.00) | 310.7 (1.00) | 310.5 (1.02) | 312.4 (1.01) | 336.6 |
| 0.19 | 312.6 (0.97) | 310.9 (1.00) | 312.8 (0.99) | 312.9 (0.93) | 314.8 (1.00) | 341.6 | |
| 0.39 | 345.2 (0.89) | 342.9 (0.91) | 343.7 (0.91) | 345.4 (0.87) | 344.8 (0.92) | 374.3 | |
| 0.50 | 369.7 (0.83) | 367.0 (0.85) | 367.1 (0.86) | 369.6 (0.82) | 367.7 (0.86) | 398.5 | |
| free | 0.54 | 380.9 (0.81) | 378.1 (0.83) | 378.0 (0.83) | 380.9 (0.78) | 378.4 (0.84) | 409.8 |
The table shows that all methods degrade by the same amount. From to free, ES rises by 20.0-21.9% for every arm including GCS (NCS +21.9%, Consistency +21.7%, CorrDiff +21.6%, EDM +20.8%, GCS +20.2%, PNO +20.0%), and falls by 16-17% for all. The degradation is graceful, and no learned method is disproportionately fragile when the coarse input stops matching the members. Since the conditions are identical across settings, a frozen model sees the same input and is scored against different targets, so the rise reflects both the condition's loss of information and a small shift in the members' fine-scale statistics. Furthermore, we are generating a precipitation dataset with independently simulated coarse fields. Unfortunately, this requires substantial GPU resources and is not yet finished, so we cannot report results from it in this rebuttal.
[REVISION] We state clearly construction and consequences in Sec. 4, Appendix D.1 and the limitations. Additionally, we add the sweep to the appendix with the framing above.
Follow-up on our response
Dear Reviewer eL2g,
Thank you for your positive and constructive review. In our response (Parts 1 and 2 above) we added the CRPS comparison for the amplitude-conditional objectives, stated when we recommend them, described how the GARD-LENS coarse condition is constructed, and added a condition–member mismatch sweep on Navier–Stokes.
As the discussion period ends on 18 November, we would be grateful to know whether this answers your questions and whether it has strengthened your view of the paper. We are happy to clarify anything further.
Part 1/2
We agree, and we answer both together because the second is the remedy for the first. Default NCS trained with the energy score is calibrated in spread (σ/s 0.98) and competitive on CRPS and spectrum, yet its lag-2 increment-kurtosis ratio is 0.21 on all 128 test conditions (0.17 on the 64 of Table 1), which means that NCS's predictions of small-scale fluctuations are far less heavy-tailed than the data's. The cause is the objective, not the sampler. The energy score is dominated by the bulk of the distribution, and rare intense cells contribute little to it. On GARD-LENS, the deficit is intensity-dependent. The ensemble is 3.8× over-dispersed at low rain rates and 0.87× under-dispersed in the tail, and an aggregate score cannot see that pattern.
Following this diagnosis, we changed only the objective and kept the model fixed. Each row below adds one amplitude-conditional term to the default energy score: amplitude-stratified ES (L2) or K62 slope matching (L4):
L4 matches how fluctuation size grows with local intensity. It raises the kurtosis ratio from 0.21 to 0.84 and more than halves logPSD at unchanged ES, CRPS and spread. Among the original-recipe baselines, only multi-step consistency sampling reaches a comparable tail (up to 1.10), and only when strongly under-dispersed (σ/s≤0.57).
Should it be the default? For fields whose tail arises from intensity-dependent variability, such as precipitation, yes: L4, or L2 if CRPS is the priority. We would not make it the default for all non-Gaussian fields, because it targets one mechanism. If the tail is intrinsic (e.g., Student-t innovations with amplitude-independent scale), Rvar is flat and L4 has nothing to match. In such a case a scale-free flatness term is the right choice (SHE-PAM, 93% closed). Rvar, computed on the default model, distinguishes the two cases before the added term is chosen (step 3 of the protocol in our answer to HC6i W6).
Whether the improved pooled tail translates into better conditional extremes is a separate question, which yLXT also raised. Please see the conditional exceedance, coverage, FSS and object diagnostics in our answer to yLXT Q4.
[REVISION]We state the default model's tail deficit and its cause in the main results and limitations and add the L4 row with CRPS to the main text and present L4 as the recommended objective for precipitation-like fields.