- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
My read is that UniDynamic combines point prediction and stochastic sampling in one network. A zero-time branch produces a source-independent point forecast. Multistep flow matching generates possible futures. Log-signature features summarize changes in the observed history. The reported gains look strong, but I'm less convinced by the experimental controls.
Critical strengths
The repeated-future DNS benchmark is the strongest part for me. It evaluates spread and distributions against many possible futures. The numerical checks and reference-size tests add useful credibility.
Those marginal energy-distance gains are substantial. Lead-20 scores improve by roughly 40–62% over the best compared baselines. I also appreciate that the advantage persists at 50 forecast steps.
Critical weaknesses
The full training recipe still feels under-tested. A one-seed encoder ablation doesn't establish why the two-mode model works. I'd want the gate, prediction loss, and flow loss isolated.
Matching parameter counts doesn't settle comparison fairness. Training exposure, checkpoint selection, and sampling cost matter too. I don't get a sufficiently clear account of those controls.
Winning marginal ED doesn't settle joint-distribution quality. Damped-wave fluctuation error is 0.0977, versus DPOT-FM's 0.0645. I'd want stronger tests of spatial and temporal dependence.
Questions for authors
Which components actually earn the improvement? Please isolate the gate, direct prediction loss, and history encoder on the same backbone. I'd want several training seeds.
Were the main baselines trained and selected under matched budgets? Please report loss weights, update counts, checkpoint rules, and seed variability. Measured inference costs would also affect my assessment.
Does removing the relative-L2 term change distributional calibration? I'd want that ablation alongside spatial and temporal dependence tests. Lower marginal ED alone wouldn't settle this for me.
How much uncertainty comes from the unresolved fine-grid state? Please test its effect while keeping the observed history consistent. That would clarify whether the DNS references match the model's forecasting target.
9 comments
Response to Reviewer eRqr (Part 2/3)
2. Baseline Fairness, Training Protocols, and Inference Costs (W2, Q2)
Comparable baselines. We added a 30M-parameter FNO and PDE-Transformer [1] SC-S (46.6M parameters) to the revised comparisons. Across eleven deterministic subsets, UniDynamic (30.7M) achieves mean full-rollout L2RE 0.04496, versus 0.10327 for FNO (30M) and 0.10703 for PDE-Transformer SC-S. PDE-Transformer is also evaluated on all three stochastic systems; UniDynamic retains lower lead-20 marginal Energy Distance on each (Table 2).
Splits and checkpoint selection. All compared baselines use the same train/validation/evaluation partitions. Both deterministic and stochastic comparisons select the best validation checkpoint. Deterministic experiments use 500 epochs with validation every 50 epochs. In the stochastic setting, UniDynamic uses 96k joint updates, batch size 32, across three systems; separately trained FNO, DPOT [2], DPOT-FM, ACDM, and GenCFD receive 32k updates per system. FNO-CRPS and DPOT-CRPS additionally use point-prediction pretraining followed by CRPS fine-tuning (32k updates for each stage per system). The 96k joint updates correspond to approximately 32k updates of training exposure per system, but do not imply identical GPU compute per update. Loss weights are specified in revised Section 4.4. The motivating DPOT/DPOT-FM study additionally reports mean and standard deviation over three training seeds (Appendix B.3, Table 5).
Measured inference cost. We benchmarked the same single-frame inference setting on an A100 80GB GPU, FP32, batch size 1, using synthetic inputs. For 1-NFE point prediction, UniDynamic takes 12.68 ms versus 42.03 ms for PDE-Transformer. For 32-NFE conditional generation, the respective times are 327.99 ms and 1297.91 ms. Peak measured memory is 0.236 GiB for UniDynamic and 0.214 GiB for PDE-Transformer. Thus, UniDynamic is about 3.3 times faster for point prediction and 4.0 times faster for 32-NFE generation in this measured setting. We distinguish inference-time NFE and wall-clock latency from training-update counts rather than treating parameter matching alone as a complete compute control.
References
- [1] Holzschuh et al. PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations. ICML, 2025.
- [2] Hao et al. DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Training. arXiv:2403.03542, 2024.
Response to Reviewer eRqr (Part 3/3)
3. Distributional Evaluation and Sources of Uncertainty (W3, Q3, Q4)
Why multiple complementary metrics? We agree that marginal Energy Distance alone does not fully assess spatial and temporal dependence. However, a high-dimensional joint distribution over entire physical fields and multi-step trajectories is difficult to evaluate reliably from finite conditional ensembles. Unlike image or video generation, where perceptual feature-based metrics such as FID/FVD are available, stochastic PDE forecasting has no single broadly established, physically meaningful counterpart that simultaneously validates all spatial and temporal dependencies. Recent benchmarks therefore combine complementary diagnostics rather than relying on one scalar: StocBench [1] evaluates conditional mean, standard deviation, Energy Distance, and long-rollout enstrophy spectra; SPDEBench [2] similarly emphasizes a suite of Sobolev and distributional metrics beyond L2 error. This is the evaluation philosophy adopted in our paper, not an attempt to equate marginal ED with joint-distribution recovery.
Evidence beyond marginal ED. Our repeated-future DNS protocol evaluates conditional mean error, conditional spread error, pointwise marginal ED, fluctuation-spectrum error, and autoregressive behavior (Section 5.3). Appendix E.2 shows individual conditional trajectories; Appendix G.3 (Figures 27–29) compares spatial fields of generated versus DNS ensemble means and standard deviations; Appendix F extends forecasts to 50 steps. UniDynamic's three-system macro fluctuation-spectrum error is 0.0936 versus 0.1345 for DPOT-FM at lead 20 and 0.1180 versus 0.1687 at lead 50. We also report the exception transparently: DPOT-FM has lower damped-wave fluctuation-spectrum error at lead 20 (0.0645 versus 0.0977). The evidence therefore covers several physically relevant aspects of stochastic forecasts, without claiming that any one metric certifies the full spatiotemporal law. Explicit lagged-correlation diagnostics would be a useful further extension.
Uncertainty from unresolved fine-grid states (Q4). We thank the reviewer for this insightful observation. Uncertainty arising from unresolved fine-scale states is an interesting question, also investigated in recent work such as Spitzer et al. [3].
We conducted controlled experiments to examine unresolved fine-grid states magnitude in our setting. Using deterministic Kolmogorov dynamics at 256×256 DNS resolution, we constructed ensembles sharing the same resolved low-frequency states but differing in their unresolved high-frequency components. Over 20-step forecasts (8 initial conditions, 32 members each), normalized pairwise spread was 0 (no measurable divergence) at 128×128, 1.79 × 10^-7 at 64×64, and 5.85 × 10^-4 at 32×32.
We further examined conditioning on 10 consecutive observed frames in the more challenging 32×32 setting (4 initial conditions, 16 members each). Compared with single-frame conditioning, enforcing consistency with the 10-frame observed history reduced future spread by approximately 3–4 orders of magnitude.
Together, these experiments indicate that uncertainty from unresolved fine-grid states is negligible under our tested observation conditions, particularly at the 128×128 resolution used by UniDynamic. Our primary focus is therefore uncertainty induced by unobserved future stochastic forcing, isolated through repeated-future DNS ensembles starting from the same high-resolution state (Section 5.1; Appendix D).
References
- [1] Pfister, Holzschuh, and Thuerey. StocBench: A Benchmark for Generative Modeling of Stochastic Dynamics. arXiv:2608.22309, 2026.
- [2] Zhu et al. SPDEBench: An Extensive Benchmark for Learning Stochastic PDEs. arXiv:2505.18511, 2025 (revised 2026).
- [3] Spitzer et al. Generative Forecasting from Coarse-Grained Observations: When Does Cascading Help? arXiv:2611.00686, 2026.
We appreciate the reviewer’s suggestions, which helped us distinguish the validated claims of the benchmark and unified model from additional possible dependence and component-level diagnostics. We welcome further discussion.
Response to Reviewer eRqr (Part 1/3)
We thank Reviewer eRqr for the detailed feedback and for recognizing the value of our repeated-future DNS benchmark. We clarify the roles of the model components, the experimental controls, and the scope of our distributional evaluation below.
1. Component Contributions and Training Objectives (W1, Q1, Q3)
History encoder. We have moved the controlled encoder ablations to the main paper (Section 6.5, Table 4), extending the original stochastic evaluation to deterministic forecasting. The comparisons keep the backbone and training setup fixed while varying history encoding. Relative to the full encoder, DPOT [1] temporal pooling with the same frame encoder increases mean deterministic rollout L2RE by 6.1% and stochastic Energy Distance by 12.9%. Removing multiscale windows or second-order order-sensitive information also worsens the corresponding average results. These experiments isolate the encoder contribution from the choice of generative objective; the controlled encoder study uses one training seed.
Source cancellation versus output gate. The term “gate” previously referred to two different mechanisms. Source cancellation at flow time zero is a structural part of the dual-mode parameterization: it guarantees a noise-independent one-step point prediction by construction, rather than serving as an optional reconstruction enhancement. The detail-adaptive output gate (Appendix C.1) is a separate, auxiliary refinement module. Its ablation improves horizon-averaged normalized ED from 0.011608 to 0.010146 and the reported relative error from 0.097512 to 0.093594. We therefore distinguish this auxiliary contribution from the central dual-mode mechanism.
Prediction, flow, and Relative-L2 losses. The zero-time prediction loss supervises the direct point readout, whereas positive-time CFM loss learns the conditional generative velocity. Both operate on the same shared network; the channelwise Relative-L2 term additionally balances physical-space errors across variables with different magnitudes (Section 4.4; Appendix C.2). Removing the flow loss would remove supervision of the positive-time velocity, so such a model would not be a controlled test of generative quality under the same training task. By contrast, removing direct prediction supervision or Relative-L2 would be useful for isolating cross-objective effects and calibration. Those independent loss-removal and multi-seed ablations are not part of the current controlled study. Our claims concern the observed performance of the jointly trained system, rather than an independently established improvement from every individual loss term.
Reference