- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper asks when a physics-residual gradient actually improves the long rollout of a neural PDE predictor. It distinguishes the residual value, agreement with an analysis-only supervised gradient, and improvement after adaptation. Its main experiment compares update spaces of equal dimension, with additional direction controls and a non-spectral architecture check. The contribution is an empirical account of correctability, rather than a new adaptation algorithm.
Critical strengths
-
The equal-dimension comparison addresses a real confound. A small adapter and a large trainable block differ in too many ways to isolate the role of the update space. Here, random-space controls and a norm-matched single step make the comparison much more informative. The fact that the finding persists without Adam is a useful part of the evidence.
-
The paper is careful about its negative results. It distinguishes supported pointwise-space effects from inconclusive head-space effects, includes a poor structured-space example, and acknowledges that oracle diagnostics cannot be used at deployment. I found this restraint helpful: the paper gives reasons to reconsider simple adaptation rules without claiming that one parameter subset is always preferable.
Critical weaknesses
-
The main result has limited independent replication. The central matched-dimension study is concentrated in one controlled system and two training regimes of the same spectral architecture. The non-spectral experiment shows that physics adaptation can help, but does not repeat that central comparison. There are also few independently trained seeds, and the low-viscosity reference has a documented resolution discrepancy. These limitations do not invalidate the reported contrast, but they leave uncertainty about how broadly the preferred update spaces will transfer.
-
Some definitions needed to audit the experiment are inconsistent. Section 3 defines a gradient and motivates a descent step, then describes the beneficial intervention with the opposite sign notation. Appendix C also uses apparently different conventions for real and complex parameter counts. The exact weak residual is only partly specified in the PDF. Since the claim depends on direction, coordinate dimension, and objective choice, I would want these points settled before treating the experiment as fully reproducible.
Questions for authors
- Does “+physics” mean the descent direction? Please state the actual displacement used and confirm that the reversal differs only in sign.
- How should the last-block and parent-space parameter counts be reconciled? Which reported dimensions expand complex entries into real coordinates?
- Can the weak-residual objective be specified completely, including test functions, normalization, and the consistency anchor?
- What are the seed-specific paired effects for the main architectural-versus-random comparison? These would help assess independent consistency beyond the pooled state count.
- Do existing runs separate low- and high-viscosity shifts or vary the residual basis? If so, does the main ordering survive those choices?
2 comments
Official Comment by Reviewer f8tb
Thanks to the author for the refutation. After reading the rebuttal carefully, I will raise the score.
Thank you for the careful review and for pointing out these issues. We went back to the existing raw results to verify the numerical details and provide the following clarifications.
Question 1 and Weakness 2 (sign convention). This is a notation error in Section 3. The applied update is the descent step Δθ = −η∇L_phys. The reversal is +η∇L_phys with the same norm, so the two differ only in sign. The random and orthogonal controls use the same norm. We will correct the text and the figure captions.
Question 2 and Weakness 2 (parameter counts). Appendix C mixes two counting conventions. 166,536 (last block) and 667,513 (full model) count each complex weight once. All matched-dimension experiments instead use real coordinates, where each complex weight counts as 2. The parent is 2×165,888 (spectral) + 648 (pointwise) + 1,249 (head) = 333,673, and every reported d is a real dimension. We will label both conventions explicitly.
Question 3 and Weakness 2 (weak residual). L_weak is the trapezoidal vorticity residual on a 10-step predicted rollout (Δt = 0.05, known forcing), projected onto 13 fixed Fourier modes k ∈ {(1,0),(0,1),(1,1),(1,−1),(2,0),(0,2),(2,1),(1,2),(2,2),(3,0),(0,3),(4,0),(0,4)}. Its value is the mean squared coefficient magnitude (forward-normalized FFT) over modes and steps, divided by the forcing mean-square (0.005). The anchor is the mean squared, std-normalized deviation from the frozen model's rollout, with weight 1. TTA minimizes L_weak + L_anchor. The one-step test uses ∇L_weak only. We will add this specification to Appendix E.
Question 4 (per-seed effects). Structured-minus-random gain in percentage points, shown as seeds 0/1/2 (60 paired states per seed):
All 24 seed-level means are positive, including those for the head comparisons whose clustered intervals include zero.
Question 5 (shift direction and residual basis). The ordering holds in all 16 cells when low- and high-viscosity shifts are analyzed separately. This includes the high-viscosity shifts, where the N=64 vs. N=128 reference discrepancy is below 0.1%. We did not vary the residual basis in this experiment and will state this as a limitation.
Weakness 1 (scope of replication). We agree that the matched-dimension result covers one system and one spectral architecture under two training regimes with three seeds, and we will state this scope explicitly. We present the DilResNet result only as an existence result.
We hope these clarifications address the reviewer's concerns and appreciate the opportunity to clarify the experimental setup and scope of our findings.