- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Kinematic Manifold Fusion, a method that uses known PDE dynamics to refine predictions from frozen PDE foundation models without updating their parameters. It combines Hermite interpolation, a correction based on physical consistency, and constraint projection to estimate intermediate states and improve autoregressive rollouts. Experiments on four PDE systems and several model families show improvements at time intervals different from those used in training, with modest inference overhead. However, gains at the native interval often come from projection alone, and some settings show little benefit or worse performance.
Critical strengths
-
KMF works with frozen PDE models without retraining, and the reported inference overhead is modest. This makes it a practical option for improving existing models. The authors measure the cost of the physics evaluations and correction steps, giving readers a concrete picture of the accuracy and runtime trade-off.
-
The authors report failures and sensitivity to calibration and operator mismatch, including cases where calibration disables the correction. These results help establish when the method is useful. They also show where the gains come from projection alone and where the proposed correction adds value, making the positive results easier to assess.
Critical weaknesses
-
Using physics to guide or correct model predictions at inference time has been widely explored [1]. KMF combines established tools such as Hermite interpolation, defect correction, and constraint projection, but the paper does not clearly explain what this combination contributes beyond existing approaches. The limited discussion and comparison with prior work make its novelty difficult to assess.
-
The additional benefit of KMF’s correction depends strongly on the setting. For requested time steps of at least 0.10 seconds, calibration selects a zero correction coefficient in 25 of 32 primary fluid configurations, leaving only constraint projection. Table 16 also reports cases where calibrated KMF performs worse than linear interpolation or the raw model, including Poseidon-L on Wave-Gauss. The authors acknowledge these limitations, but they leave the evidence for benefits beyond projection or retaining the original prediction concentrated in a narrower set of configurations. I would appreciate it if the authors could clarify this.
[1] DiffusionPDE: Generative PDE-Solving Under Partial Observation. Huang et al. NeurIPS 2024.
Questions for authors
-
What is the main methodological advance over existing physics-guided inference and correction methods? Please explain which part of KMF is new and what the experiments show about its benefit beyond combining established numerical techniques.
-
Across the evaluated settings, how often does KMF improve on projection alone or simply retain the raw model prediction? Can you summarize this with confidence intervals over test trajectories?
-
The operator-mismatch experiments recalibrate KMF for each assumed operator. How sensitive is performance to operator errors when the calibration parameters remain fixed?
9 comments
On improvement with correction over projection along & Robustness to operator mismatch without recalibration
2. How often does correction improve over projection alone?
The results demonstrate that KMF's physical correction provides substantial benefits beyond projection alone, rather than merely retaining the original predictions. Across all 126 Task 2 configurations, KMF improves over projection in 81 (64.3%), matches it in 43 (34.1%), and degrades in only 2 (1.6%).
Importantly, correction is actively selected () in 83 configurations and improves performance in 81 of them (97.6%). The remaining 43 configurations select , which is an intentional feature of KMF's calibration: when additional correction is not beneficial on validation data, the method retains the projection-only solution rather than forcing an unnecessary update. Consequently, 124/126 configurations (98.4%) match or improve upon projection, and KMF outperforms the raw FM rollout in 125/126 configurations.
| Outcome | All 126 configurations | Active correction (83) |
|---|---|---|
| Improved over projection | 81 (64.3%) | 81 (97.6%) |
| Equal to projection | 43 (34.1%) | 0 |
| Degraded | 2 (1.6%) | 2 (2.4%) |
To establish that these gains are not artifacts of averaging, we additionally report paired results across 20 held-out trajectories for each primary active-correction setting:
| Dataset | Projection RMSE | KMF RMSE | Gain (95% paired CI) |
|---|---|---|---|
| NS-Gauss | 0.06332 | 0.05309 | 16.15% [15.82%, 16.46%] |
| FNS-KF | 0.02623 | 0.02472 | 5.73% [4.97%, 6.51%] |
Both improvements are statistically significant (Holm-adjusted ).
These results establish that physical-defect correction is not merely a fallback to projection: it is actively used in most evaluated configurations and provides consistent, measurable improvements when selected. The only two degradations are 0.10% and 0.22%, demonstrating that failures are rare and small in the evaluated matrix. While no calibration procedure guarantees improvement on every unseen trajectory, KMF combines effective active correction with the ability to avoid unnecessary interventions when validation does not support them.
3. Robustness to operator mismatch without recalibration
To assess sensitivity to operator mismatch, we evaluated KMF using nominal fusion weights calibrated once under the original operator and held fixed across all tested viscosity and forcing perturbations, without recalibrating for each perturbed operator.
| Dataset | Perturbations | Maximum RMSE difference from recalibration | Fixed-weight gain over FM + projection |
|---|---|---|---|
| NS-Gauss | 10 | 0–20.16% | |
| FNS-KF | 50 | 6.85–13.05% |
Even without recalibrating for the perturbed operators, KMF maintains strong performance. On FNS-KF, it improves over FM + projection in all 50 tested settings, with gains of 6.85–13.05%. On NS-Gauss, it achieves improvements of up to 20.16% in five settings, while the remaining five use and retain the FM prediction.
Furthermore, recalibrating the fusion weights for each perturbed operator changes RMSE by at most on NS-Gauss and on FNS-KF, demonstrating that the nominal weights remain effective across the evaluated perturbations.
Thus, KMF does not depend on recalibration for every operator variation to maintain its effectiveness in the tested settings. Calibration provides an additional opportunity to adapt the fusion weights, but the results show that repeatedly recalibrating them is not necessary to achieve meaningful improvements across these operator perturbations.
Thank you for your time and thoughtful consideration. We have provided detailed responses and additional experimental evidence to thoroughly address all the points raised in your review.
Please let us know if any substantive concerns remain, as we would be glad to offer further clarification.
If you feel these concerns have been adequately resolved, we kindly ask that you consider raising your overall rating.
On novelty and contribution beyond existing methods
Dear Reviewer zbnk,
Thank you for your constructive feedback. We address your three concerns below.
1. Novelty and contribution beyond existing methods
We agree that physics-guided inference is not new. However, DiffusionPDE addresses a different problem using diffusion-based generation, where the denoising process provides a mechanism for incorporating physical information. This mechanism is not available in general autoregressive PDE foundation models.
KMF addresses two important practical challenges simultaneously: (1) enabling physics-guided correction when the foundation model is available only as a black box, with access limited to its input-output inference interface and the governing PDE operator (unlike diffusion), and (2) enabling accurate predictions at flexible temporal cadences, including off-native intervals where foundation models may otherwise lose accuracy. To the best of our knowledge, KMF is the first training-free framework to jointly address both challenges, without requiring access to model internals, modifying model parameters, or retraining the foundation model.
This setting is important for the practical use of PDE foundation models. When using a pretrained FM, we often have access only to its inference interface, while modifying its parameters or retraining it can be expensive or infeasible. At the same time, scientific applications such as fluid dynamics, climate forecasting, and coupled simulations often require predictions at temporal cadences different from those used during training. Even models supporting variable time intervals can lose accuracy at off-native cadences. KMF addresses these challenges in two stages. First, it enables physics-informed temporal refinement between available FM predictions using a Hermite bridge, without requiring direct off-native queries. Second, it builds on this refinement to perform causal rollout correction, using the Hermite–Simpson physical defect to correct FM predictions before they are fed back into subsequent inference steps. Both stages operate at inference time, without modifying model parameters, retraining, or numerically integrating the PDE forward.
Unlike diffusion-based correction, KMF requires no diffusion scores or denoising trajectory. Unlike Jacobian-based correction approaches such as PhysicsCorrect, it requires no cached Jacobian or pseudoinverse and additionally provides dense intermediate-time predictions.
The experimental evidence supports both the method's effectiveness and transferability. Table 3 isolates the contribution of active physical correction beyond projection, showing improvements of 16.15% on NS-Gauss and 5.73% on FNS-KF. Evaluations across four PDE systems and multiple foundation-model architectures further demonstrate that the same inference-time mechanism can be applied without changing the underlying models.
Thus, our contribution is not the individual numerical components, but a lightweight, architecture-independent approach that jointly addresses off-native temporal refinement and causal physical correction of frozen PDE foundation models.