- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a method for reconstructing physical fields consistent with a set of given conditions. The method factorises physical parameters from state variables that can be derived from the forward operator. It then performs diffusion-based generation over the joint field space, predicting the physical parameters and deriving the state variables from the known physics at each diffusion step. The method is evaluated on out-of-distribution settings with simulated data.
Critical strengths
The method ensures that predicted parameter-state pairs are consistent with the embedded numerical solver, without requiring an additional physics-residual loss. The experiments cover multiple PDE systems and include ablations examining the contributions of the different components.
Critical weaknesses
-
Limited novelty. A primary contribution is the factorization into learned physical parameters and solver-generated dependent states, but this approach has substantial overlap with prior work combining latent generative models and differentiable PDE solvers (e.g., LD-DIM, L-DPS, GenPANIS). While embedding this factorization directly into a joint-space diffusion denoiser is a meaningful architectural distinction, it is unclear whether this constitutes a sufficiently substantial methodological advance.
-
Insufficient justification of the proposed architecture. The experiments demonstrate the benefits of solver-based rendering, but it is unclear whether the proposed joint-space diffusion formulation offers significant advantages over simpler parameter-only generative approaches followed by the same solver. Indeed, the controlled ablation shows that simpler alternatives achieve comparable or better unconditional generation performance. This raises questions about whether the additional complexity of joint-space diffusion is justified.
Questions for authors
- [Clarification] Please can you clarify what joint-space diffusion offers over parameter-only generative models followed by the same numerical solver? In particular, how should we interpret the comparable or better unconditional generation results of simpler methods in Table 4? E.g., in Table 4, MPDMfield performs almost identically to MPDM on OOD denoising (0.5598 vs. 0.5576), suggesting that most of the improvement comes from solver-based rendering rather than compact latent parameterization.
- [Clarification/Future work] To what extent are the OOD improvements due to the proposed diffusion architecture, rather than access to the correct test-time physical conditions through the solver? Would simpler physics-aware baselines achieve similar results given the same information?
- [Future work] Please can you report wall-clock training and inference times relative to the baselines? How does the cost of repeated PDE solves compare with parameter-only generation followed by a single solve?
6 comments
[CW2]: Justification of Joint-Space Diffusion
On the motivation for joint-space diffusion. The distinction between MPDM and parameter-only generative models lies in the inference objective, rather than the ability to produce solver-consistent states. A parameter-only generator learns the coefficient distribution and subsequently renders the dependent states through a numerical solver. MPDM instead learns to recover physical parameters from noisy joint parameter--state observations, using both coefficient reconstruction and solver-rendered state reconstruction to train its denoiser. Consequently, the dependent physical states contribute directly to learning the underlying coefficient representation, rather than being generated only after coefficient prediction. This provides an integrated formulation for joint-field denoising and physical parameter inference under changing physical conditions.
On the unconditional generation results. The original submission already included coefficient-only baselines (K-DM + Solver, K-LDM + Solver, and VAE-K + Solver) and explicitly separated paired OOD denoising from unpaired unconditional generation in Table 4 and Appendix A. VAE-K + Solver achieves the lowest unconditional Joint (0.0783 versus 0.3389 for MPDM), as already acknowledged in Section 5.3 and Appendix A. This result demonstrates the effectiveness of directly modeling the coefficient distribution for unconditional generation. MPDM, however, is designed to exploit noisy joint-field observations for coefficient recovery and dependent-state reconstruction. A coefficient-only generator followed by a solver does not, by itself, provide the corresponding observation-conditioned inference mechanism. Thus, the unconditional generation results and MPDM's joint-field denoising advantages characterize complementary modeling capabilities rather than contradictory findings.
On controlled evidence for the architecture. We have strengthened the experimental evidence through the additional DM + Solver comparisons in Appendix H and MPDM$_{\mathrm{field}}$ results in revised Tables 1–3. All solver-based methods use the same numerical solvers and OOD physical conditions. Relative to DM + Solver, MPDM reduces coefficient MSE from 1.04826 to 0.55704 on Darcy, from 3.188 to 1.092 on Helmholtz, and from 0.06434 to 0.03755 on Navier--Stokes, while substantially improving state reconstruction. Furthermore, MPDM consistently outperforms MPDM$_{\mathrm{field}}$ in state and coefficient MSE across all three PDEs, isolating the benefit of learned coordinate parameterization within the same joint-space diffusion framework. The additional intrinsic-dimensionality experiments in Appendix A further show that the relative OOD denoising improvement over MPDM$_{\mathrm{field}}$ increases from 0.4% at six dimensions to 18.4% at fifteen dimensions. These results establish measurable benefits from both solver-integrated learning and compact parameter prediction.
On the computational trade-off. The additional computation serves the joint-field inference objective. In the reported paired OOD denoising evaluations, MPDM uses a single denoising prediction and one batched PDE rendering step, while full multi-step DDPM generation invokes the renderer at each reverse step. We have additionally reported wall-clock training and inference comparisons in revised Appendix B.3, allowing the reconstruction benefits to be assessed alongside computational costs. Taken together, the results justify joint-space diffusion for physically structured denoising and parameter recovery, where the learned predictor exploits coupled physical observations to achieve substantially more accurate reconstructions than solver post-processing alone.
[Q1]:
On the benefit of joint-space diffusion. Parameter-only generators learn a distribution over coefficients and subsequently render the dependent states, whereas MPDM learns to recover coefficients from noisy joint parameter--state observations. Its joint-field reconstruction objective combines direct coefficient supervision with state-reconstruction gradients propagated through the numerical solver. Thus, the physical states contribute to learning the coefficient predictor rather than being generated solely after coefficient sampling. This distinction is particularly relevant to paired OOD denoising and inverse parameter recovery.
[Q1]:
On the controlled ablation. The original submission already included parameter-only solver baselines and explicitly separated paired OOD denoising from unpaired generation in Table 4 and Appendix A. The stronger unconditional Joint of VAE-K + Solver (0.0783 versus 0.3389 for MPDM) therefore reflects a task-specific advantage of coefficient-distribution modeling rather than an unexplained failure of MPDM. Regarding the small MPDM--MPDM$_{\mathrm{field}}$ gap in the original six-dimensional setting, the additional experiments in Appendix A show that MPDM's relative OOD denoising improvement increases from 0.4% at 6 dimensions to 5.9% at 10 dimensions and 18.4% at 15 dimensions. Moreover, revised Tables 1–3 demonstrate consistently lower state and coefficient MSE for MPDM than MPDM$_{\mathrm{field}}$ across Darcy, Helmholtz, and Navier--Stokes. These results establish the additional value of compact coordinate parameterization within joint-field denoising, beyond the shared use of a numerical solver.
[Q2]:
On disentangling solver and learning contributions. We have introduced DM + Solver and strengthened the MPDM$_{\mathrm{field}}$ comparisons to distinguish numerical rendering from learned coefficient inference. Importantly, all solver-based methods use the same numerical solvers and OOD physical conditions, so MPDM's advantages cannot be attributed solely to exclusive access to the correct test-time conditions. DM + Solver renders physically consistent states from DM-predicted coefficients but does not improve the coefficient estimates themselves. MPDM$_{\mathrm{field}}$ integrates solver-based state reconstruction into diffusion training, while MPDM further introduces learned coordinate-space parameterization.
On the experimental evidence. In revised Appendix H, MPDM reduces coefficient MSE relative to DM + Solver from 1.04826 to 0.55704 on Darcy, 3.188 to 1.092 on Helmholtz, and 0.06434 to 0.03755 on Navier--Stokes, alongside consistent improvements in state reconstruction and inverse consistency. The additional MPDM$_{\mathrm{field}}$ comparisons in revised Tables 1–3 further demonstrate the benefit of compact coefficient prediction under the same solver-integrated training framework. Together, these results provide direct evidence that MPDM's OOD improvements reflect learned parameter inference and structured diffusion parameterization, in addition to the physical consistency supplied by the numerical solver.
[Q3]:
On wall-clock efficiency. We report relative wall-clock training and inference measurements for the three main PDE benchmarks, normalized to the standard DM baseline (1.0). The following comparison includes solver-based and parameter-only alternatives, while the MPDM versus MPDM$_{\mathrm{field}}$ comparison is also documented in revised Appendix B.3 (Table 8):
PDE Method Relative Training Time Relative Inference Time Darcy DM + Solver 1.000 1.481 MPDM$_{\mathrm{field}}$ 0.771 1.254 VAE-K + Solver 0.022 1.009 MPDM 0.181 1.007 Helmholtz DM + Solver 1.000 1.922 MPDM$_{\mathrm{field}}$ 1.322 1.621 VAE-K + Solver 0.057 1.889 MPDM 0.431 2.035 Navier--Stokes DM + Solver 1.000 5.486 MPDM$_{\mathrm{field}}$ 1.298 4.327 VAE-K + Solver 0.019 3.117 MPDM 2.080 3.957
On repeated PDE solves. In the paired OOD denoising evaluation, MPDM performs a single clean-state prediction followed by one batched PDE rendering call, comparable to parameter-only prediction followed by the same solver. Full multi-step DDPM sampling instead evaluates the solver at each reverse step, whereas parameter-only generation requires only a final PDE solve. This distinction is important when comparing the computational requirements of denoising and unconditional generation.
On the accuracy--efficiency trade-off. MPDM achieves substantially lower state reconstruction and coefficient errors than the solver-matched alternatives, with solver-dependent computational costs. Compared with MPDM$_{\mathrm{field}}_{\mathrm{field}}$ timing comparison is also reported in revised Appendix B.3 (Table 8).
We thank the reviewer for the constructive feedback.
[CW1]: Methodological Novelty Beyond Latent Generative Models and PDE Solvers