- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Ambient Physics, a training framework for neural PDE solvers that reconstructs complete coefficient and solution fields from partial observations of both fields. The authors introduce three models: Ambient Flow, Ambient FNO, and Ambient U-Net.
For the main model, Ambient Flow, the network learns a mapping from partial observations to the complete fields . To prevent the network from simply copying the observed values, an additional random mask is applied, and noise is added to the retained observations . The resulting network input is . Training follows the flow-matching framework, with the loss evaluated on the originally observed entries . At inference time, the model reconstructs using the same masking and conditioning procedure as during training.
The main contributions are:
- The paper proposes the Ambient Physics framework for joint reconstruction of coefficient and solution fields from incomplete training observations, using additional masking and clean observed values for reconstruction. Three implementations are provided: Ambient Flow, Ambient FNO, and Ambient U-Net.
- The paper studies the effect of additional masking on reconstruction performance across four PDE problems and finds that withholding even a single observed measurement can substantially improve reconstruction compared with training without additional masking.
Critical strengths
- The paper provides a training approach for joint reconstruction using only partial training observations. By combining additional masking with explicit conditioning on clean observations, the method achieves impressive results on four types of PDEs.
- The Ambient Physics framework also achieves strong results with different backbones, including FNO and U-Net, supporting the value of the framework across architectures.
Critical weaknesses
- The algorithmic advances over prior work are limited. Ambient Diffusion and IDCD already include related designs for training with incomplete observations and further masking observed entries, while methods such as DiffusionPDE support joint reconstruction using observations of both fields. Appendix I claims that IDCD does not study the relevant ratios, yet IDCD already includes context–query ratio experiments.
- The corresponding baseline values in Table 1 match those in FunDPS, where forward and inverse tasks are evaluated separately using observations from only one field, whereas the proposed method uses observations of both fields. Given that both FunDPS and DiffusionPDE support observations of both fields, the paper does not clearly establish whether these results were obtained under matched observation conditions.
Questions for authors
- Given that IDCD already uses context–query masking and studies the corresponding ratios, is the main algorithmic addition over Ambient Diffusion and IDCD essentially the explicit use of clean observations as conditioning inputs?
- The baseline results in Table 1 match those in Table 1 of FunDPS, where the corresponding experiments use observations from only one field. Please clarify whether these results were directly quoted. If the original single-field results were used, given that both FunDPS and DiffusionPDE support observations of both fields, could you provide matched comparisons using the same observations of both fields?
- Although the paper compares with IDCD in the appendix, it does not provide detailed experimental settings. Could you provide the full experimental details, such as the evaluation metrics and numerical error values?
2 comments
Thank you for the detailed rebuttal and additional experiments.The authors added a comparison experiment between FunDPS and Ambient Flow under matched observation of both fields which address my concerns about fairness in the main experiment. The author provides an additional comparison between IDCD and Ambient Flow on the Darcy problem, addressing my concern about the difference between Ambient Flow and IDCD. But the author's statement about the innovation of Ambient Physics over Ambient Diffusion didn't completely convince me. Considering the author's detailed experiments and results, I will raise the rating from 2 to 3.
Response to Reviewer YsCE
We thank the reviewer for their review and for recognizing that Ambient Physics enables learning directly from partial observations and achieves strong results across PDEs and architectures. We address each concern below.
Ambient Diffusion and IDCD (Weakness 1, Q1):
Ambient Physics does not use what IDCD refers to as "context-query masking," and our withholding ratio is a different quantity from IDCD's "context and query mask ratio."
In IDCD, the context and query subsets are resampled at every training step (see their public code: https://github.com/LOGO-CUHKSZ/incomplete-data-complete-dynamics/blob/720c701967f031f317a55d5ee2705d6143aa6f21/ns_uniform_missing/models/sde.py#L105). This means that, given enough training steps, no observation is withheld throughout training; every observation is eventually given to the model as input. IDCD's ratio is this per-step subsampling rate.
In Ambient Physics, each training example has a fixed additional mask throughout training. Withheld observations are never given to the model as input. Our ratio is between withheld and not withheld observations, and studying this, we discover the one-measurement transition. We will highlight these fundamental distinctions in Appendix I.
To show that these distinctions matter empirically, we perform an additional experiment with identical training budgets, architectures, data, and observation masks, only replacing the Ambient Physics objective with IDCD's objective (see Q3 below), and observe a 1.5-2x higher error.
Beyond this, Ambient Physics extends ambient training to widely used (deterministic) neural solvers like FNO and UNet (Table 2), and super-resolution tasks (Table 6).
Baseline: FunDPS (Weakness 2, Q2):
Table 1 includes FunDPS's published results, where they formulate the forward and inverse problems separately. In our work, we formulate the generalized reconstruction problem in which both fields may be partially (or completely) observed.
As an additional experiment, we apply FunDPS (NFE=500) to the reconstruction problem in which both fields are partially observed (3%) and passed in as input simultaneously. We report the results in the table below.
Applying our reconstruction formulation to FunDPS reduces its errors, confirming the benefit of both fields being passed as input simultaneously (shown in Table 2). Still, Ambient Flow remains better on Darcy Flow, Helmholtz, and Poisson (coefficients and solutions), without a single complete training example. We will include these results in the Appendix.
Empirical comparison with IDCD (Q3):
For ERA5 experiments, we use nine variables at 103x120 spatial resolution, but unlike IDCD, which reconstructs 3-hour windows, we reconstruct a single time-step (giving the model strictly less information). Each field is 20% observed. Architecture and optimization match our main experiments. Ambient Physics achieves an MSE of 0.038, while IDCD reports an MSE of 0.250. Figure 18 shows IDCD's published prediction (their Figure 2) with visible speckles consistent with their sampler copying observed points into the output. Ambient Physics' prediction is sharper and without these visible artifacts.
To provide a more rigorous quantitative comparison, we performed an additional experiment by implementing IDCD's objective and sampler in our pipeline. We use the Darcy Flow dataset, the reconstruction problem framing, same training budget (25 epochs), same observation masks (3%), and architecture (UNet). We report the results in the table below.
Ambient Flow achieves 33.5% lower misclassification rate on the coefficient field and 49.9% lower relative L2 error on the solution field. IDCD has higher error on more than 99% of test samples. Note that IDCD's default sampler uses an ensemble of 10 predictions. We will include these results in Appendix I.
We believe these additional clarifications can directly address the reviewer's concerns, and we welcome any further discussion.