- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether enforcing physical constraints improves the accuracy of autoregressive neural PDE surrogates. The authors focus on gradient-flow systems and enforce free-energy monotonicity through inference-time convex-splitting corrections. They establish a discrete energy monotonicity guarantee and introduce a certificate-to-error ratio and correction-error alignment to characterize prediction improvements. Experiments on Allen–Cahn, Cahn–Hilliard, and grain-growth systems show that satisfying the same energy constraint can lead to substantially different improvements in prediction accuracy. The paper also examines the effects of corrections on long-horizon rollouts and physical evolution kinetics.
Critical strengths
Strength
-
The paper tried to address a meaningful question concerning the relationship between physical constraint satisfaction and prediction accuracy. In particular, the experiments distinguishing energy monotonicity, field accuracy, and coarsening kinetics are useful. The inclusion of unsuccessful corrections, mis-specified energy functionals, and different enforcement strategies provides a more informative picture than simply demonstrating improved prediction accuracy.
-
The paper evaluates multiple gradient-flow systems, neural architectures, and training configurations. The contrasting results for Allen–Cahn and Cahn–Hilliard provide an interesting empirical motivation for investigating the limitations of energy-based constraints.
Critical weaknesses
Weaknesses
-
Inference-time physical constraint enforcement for neural PDE surrogates has already been studied. For example, Rochman Sharabi and Louppe (2025) enforce governing-equation constraints through training-free projections. The distinction made in Section 2 between “temporal free-energy sublevels” and “instantaneous residuals” is not sufficiently justified. The prior work explicitly discusses temporal consistency and jointly enforces PDE constraints over entire space-time trajectories. In contrast, the present paper enforces energy monotonicity sequentially between consecutive states. Moreover, the convex-splitting correction relies on established numerical techniques. The theoretical results are also rather elementary.
-
The emphasis of this paper seems lie in analysis on the difference correction effectiveness. However, the analytical depth is insufficient:
(1) Insufficient explanation of the Allen–Cahn and Cahn–Hilliard difference. The paper does not establish how the underlying PDE dynamics and prediction error modes affect the ability of the energy certificate to detect and correct errors. This is particularly relevant since the two systems share the same free-energy functional but exhibit substantially different correction outcomes. Moreover, their baseline prediction errors differ considerably, making it difficult to isolate the role of the underlying dynamics.
(2) Post-hoc characterization rather than explanation. The proposed ratio and correction-error alignment are computed after the correction and are directly related to the resulting local improvement. They characterize whether a correction is effective, but do not explain why a particular physical constraint produces an effective correction in the first place.
(3) The role of the enforcement mechanism is unclear. Section 5.2 shows that generic backtracking and convex-splitting corrections satisfy the same energy monotonicity condition but produce very different coarsening exponents. This suggests that the enforcement operator itself plays an important role. In particular, convex splitting already incorporates gradient-flow structure, which may contribute to the observed improvements. However, the paper does not sufficiently separate the effects of the certificate from those of the correction method.
(4) Limited connection to long-horizon behavior. The theoretical analysis focuses on single-step corrections, whereas the main experimental observations concern autoregressive rollouts. The authors themselves show that local and rollout-level improvements can differ substantially. For example, Appendix F, Table 4 reports cases with negative median local benefits but positive rollout benefits. The proposed analysis does not sufficiently explain how local correction properties translate into long-horizon prediction accuracy.
Questions for authors
-
What additional insight does the correctability analysis provide beyond the geometric identities? Since the local benefit is algebraically determined by and , can the authors identify a nontrivial implication that is specific to physical constraint enforcement or the underlying PDE dynamics?
-
Can the authors provide a more direct explanation of the different correction effectiveness for Allen–Cahn and Cahn–Hilliard? In particular, how does this relate to their different dynamics and prediction error modes? Would the conclusions remain the same when controlling for baseline surrogate accuracy?
-
How much of the observed improvement comes from the energy certificate itself, rather than the convex-splitting correction operator? Given the substantially different kinetics obtained with the same energy constraint, can the authors clarify the role of the enforcement mechanism and its influence on the effective rollout dynamics?
5 comments
Response to Reviewer EA9y (2/3)
W2(3): which part comes from the operator
"The role of the enforcement mechanism is unclear. Section 5.2 shows that generic backtracking and convex-splitting corrections satisfy the same energy monotonicity condition but produce very different coarsening exponents."
The certificate fixes the target and hence the gap that must be closed; the operator decides how far past it the state travels and in what direction. Section 5.2 now reads Table 3 as an operator ablation on one setting: three interventions reach zero violation and end at relative 0.81 (energy descent), 0.72 (monotone) and 0.36 (rate target), against 3.69 unconstrained. The generic-backtracking control is the cleanest split, because it holds the certificate fixed and changes only the operator: it reaches the same monotone target and nearly freezes coarsening, with fitted exponent 0.001 against the reference 0.35. So the certificate supplies feasibility and a bounded budget, and the gradient-flow direction of the corrector supplies the kinetics; Section 3.3 states that convex splitting is established machinery used as a controlled intervention. The rate-target gain is setting-dependent: it over-dissipates a stronger Allen-Cahn rollout and is frequently infeasible for Cahn-Hilliard (Section 5.4).
W2(4): single-step analysis and rollouts
"Limited connection to long-horizon behavior. The theoretical analysis focuses on single-step corrections, whereas the main experimental observations concern autoregressive rollouts."
The single-step question is answered below. The Table 4 rows you cite are the reversals App. F.4 now prints, and the A2 seed 1 row is the escape case where a negative local benefit coexists with a full rollout rescue. Revision. Section 3.3, Section 5.1 and App. F.4.
Q1: insight beyond the identities
"What additional insight does the correctability analysis provide beyond the geometric identities?"
Beyond the identities, the analysis makes one claim the 627 runs could have refuted: an energy inequality can correct only when its correction budget closes the gap that triggered it, which is why the same certificate removes 75.6% of the field error on Allen-Cahn and 1.1% on Cahn-Hilliard (Table 1; abstract). The capacity condition holds in 627/627 controlled runs under the drift-corrected form and in 348/627 under the raw form, with 279 violations (App. O, Table 12). Revision. Section 4.2 and App. O, Table 12.
Q2: controlling for baseline accuracy
"Can the authors provide a more direct explanation of the different correction effectiveness for Allen-Cahn and Cahn-Hilliard? In particular, how does this relate to their different dynamics and prediction error modes? Would the conclusions remain the same when controlling for baseline surrogate accuracy?"
The control you ask for is the matched-visibility regression in App. O: the system indicator has no detectable residual effect on once visibility is fixed, and the 627 controlled perturbations do not inherit the trained surrogates' baseline errors. Because the conclusions are stated in terms of rather than the system label, a different baseline accuracy moves and moves the prediction with it. Revision. App. O, Table 12 and Section 4.3.
Response to Reviewer EA9y (3/3)
Q3: certificate versus correction operator
"How much of the observed improvement comes from the energy certificate itself, rather than the convex-splitting correction operator? Given the substantially different kinetics obtained with the same energy constraint, can the authors clarify the role of the enforcement mechanism and its influence on the effective rollout dynamics?"
The operator ablation in Table 3 and the generic-backtracking control separate the two, and the kinetics follow the operator's direction rather than the certificate. Revision. Section 5.2 and Section 5.4.
What the analysis adds beyond the geometric identities
"Since the local benefit is algebraically determined by and , can the authors identify a nontrivial implication that is specific to physical constraint enforcement or the underlying PDE dynamics?"
is the reverse triangle inequality, and Section 1 states this. is first order, and the Fig. 3(b) caption now labels it an identity to - a consistency check rather than a test. The statement that is not an identity is the capacity condition: the energy gap that activated the certificate must be closed along the segment, so the mean value theorem and Cauchy-Schwarz give a lower bound on the correction the corrector must be able to express. Across 627 controlled perturbations with three correctors (ideal projection, convex splitting, gradient-flow line search), holds in all 627 with minimum slack , while holds in 348 (Section 4.2, App. O, Table 12). The two forms differ by the reference's own dissipation, 0.44 at the median run, which is why the naive form fails. This concern was also raised by Reviewer MqNi (W2) and Reviewer seKT (W1); their answers point here.
Single-step analysis, long-horizon rollouts
"The authors themselves show that local and rollout-level improvements can differ substantially. For example, Appendix F, Table 4 reports cases with negative median local benefits but positive rollout benefits."(4)
The analysis is a single-step statement, and Section 3.3 now states this: the certificate constrains admissibility, not the size of the correction, and it is not a convergence statement for the learned trajectory. Alignment predicts the sign of the rollout effect on the seed-resolved rows, which we reconcile in Reviewer MqNi's answer. The size is set by autoregressive feedback: on the unstable U-Net rollout, sustained correction rescues the trajectory ( at a per-step ), while a single certified intervention at an early step leaves it to re-diverge (; Section 5.1, Fig. 4). We do not have a theorem that maps local correction properties to long-horizon accuracy, and the paper does not claim one. This concern was also raised by Reviewer seKT (W3, Q2); that answer points here.
Response to Reviewer EA9y (1/3)
Thank you for the report, and in particular for the Allen-Cahn / Cahn-Hilliard question; the replies follow your numbering, and the shared answer for each concern sits at the end of the section that raised it first.
W1: inference-time enforcement is prior work
We accept that inference-time projection is prior art and do not claim the projection; Section 3.3 and App. J say the same. What Section 2 now separates is the algebraic type and cost of the constraint: the closest prior work enforces a PDE residual at inference, a space-time equality that requires the operator, while we enforce a scalar temporal inequality that requires only Fh and a descent step. The prior work you cite does enforce consistency over space-time trajectories; that is a space-time equality, and it is a different object from a sequential inequality between consecutive accepted states. The elementary-algebra half of your point is answered below. Revision. Section 2 states the distinction as algebraic type and cost, and Section 2, Section 3.3 and App. J state that the projection mechanism is not claimed as novel.
W2(1): the Allen-Cahn / Cahn-Hilliard difference
The two systems differ in how much of the error the energy can see at their own interface widths, and that is what R measures. At matched visibility the system dummy on R is −0.0013±0.032 (n=252; App. O, Table 12), so the system label adds nothing detectable once visibility is fixed. Cahn-Hilliard sits at median R=0.013-0.017 with median Blocal=2-3×10−5 across three seeds, and over the Cahn-Hilliard steps the maximum is Blocal=2.9×10−3 (Section 4.3, App. F.3). The all-archive maximum, 0.624 at A1 seed 0, is an Allen-Cahn step and is now named as such. The 627-run scan applies three correctors to controlled perturbations of reference states; it is not a re-run of the trained surrogates, so it does not inherit their baseline errors. Revision. Section 4.3 names the Cahn-Hilliard range together with the all-archive maximum, and App. O records the matched-visibility check.
W2(2): post-hoc characterization
You are right that both quantities are measured after the correction, and we now say so in Section 1 and in the Fig. 3(b) caption. What Section 4.2 adds is a condition the definition does not contain: the certificate can correct only when its budget can close the gap that activated it, and that condition can fail. The identity-versus-capacity split is answered below. The alignment term is presented as a consistency check to O(Rδ), not as an explanation. Revision. Section 1, Section 4.2 and the Fig. 3(b) caption label the geometry as geometry.