- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates whether the open-loop forecast accuracy of neural operators reflects the quality of controllers trained through them using differentiable predictive control. The authors follow an existing DPC pipeline and compare four configurations: FNO₁, FNO₅, RNO, and TI-DON. The main finding is that forecasting and control performance rankings do not always agree, with FNO₅ being the most consistent configuration among those tested. The paper also presents a policy-dependent transfer error bound and a counterexample in which the forward-model error tends to zero while the policy-gradient error remains nonzero.
Critical strengths
The research question is relevant, and the evaluation separates useful quantities. Distinguishing predictive accuracy, control performance within the surrogate, and control performance on the numerical plant helps avoid equating better prediction with better downstream control.
Critical weaknesses
-
The paper follows an existing DPC pipeline, so its value depends primarily on whether the comparative experiments yield reliable and generalizable new insights. However, all tasks involve one-dimensional periodic PDEs with fixed actuator layouts, constant reference targets, and low-dimensional families of initial conditions. The paper does not compensate for this limited scope with sufficiently in-depth controlled analysis and, overall, reads more like an exploratory comparison of configurations.
-
Confounding factors in the key comparisons make attribution difficult. FNO₁ and FNO₅ differ not only in supervision horizon but also in learning-rate schedule, number of training epochs, training-window construction, and checkpoint-selection criterion. These results are therefore better interpreted as comparisons between specific configurations rather than sufficient evidence for the effects of the training mechanisms or the relative merits of the methods.
-
The connection between theory and empirical results is weak, and one theoretical inference is unsupported. The transfer error bound and gradient counterexample explain why predictive accuracy cannot provide general control guarantees, but they do not adequately explain the observed performance differences across the models evaluated in this paper.
Questions for authors
- Controlled comparisons.
Do the main advantages of FNO₅ over FNO₁ persist when optimization settings, training budgets, and checkpoint-selection protocols are controlled? For PPO, which conclusions remain valid after aligning the training objectives and specifying comparable budgets?
- Mechanistic explanation.
For the TI-DON failure on Cahn–Hilliard, what evidence distinguishes the roles of Jacobian error, closed-loop distribution shift, and policy-optimization failure? Can a targeted controlled experiment support the proposed explanation, rather than relying only on associations observed at selected trained checkpoints?
2 comments
Thank you for the clarifications. I appreciate your acknowledgment that the results concern complete training configurations and that the diagnostics do not establish causality. These qualifications are helpful, but several substantive concerns remain.
-
Controlled comparisons. The approximately matched training time does not isolate supervision horizon from optimization and checkpoint-selection choices. Do the FNO₅ advantages persist under controlled settings? For PPO, matching the stage cost is insufficient: Eq. (14) adds an intermediate-state tracking penalty to DPC that is absent from PPO. Which conclusions remain after accounting for this difference?
-
Robustness and practical significance. Please provide the completed independent-surrogate-seed results, particularly for the smaller ranking differences. Given the reported cumulative-cost differences below 1% among FNO/RNO policies, what practical benefit do the endpoint improvements establish?
-
TI-DON failure. Does the proposed learning-rate experiment resolve the failure within the surrogate, and does the result persist across surrogate seeds? This would clarify optimization sensitivity, although attributing the failure specifically to Jacobian error would still require additional evidence.
Thank you for the assessment. We clarify the benchmark’s physical scope and the rationale for the training configurations below.
Benchmark scope. The six PDEs span nonlinear advection, phase separation, dispersion and chaos. Across all PDEs, the dynamics surrogates use a common data-generation procedure with bounded multisine controls sampled across five temporal frequency bands. Fixed actuator layouts simplify the analysis of forecast–control discrepancies. Zanotta et al. (ICML 2026) demonstrate PDE control with variable actuator configurations using DeepONet policies. Our study examines how learned dynamics affect policy training and controller performance.
Section 5.4 extends evaluation beyond the original initial-condition draws through amplitude scaling from 0.5 to 2, additive Gaussian perturbations and noisy burn-in. We report where controller performance holds or degrades under these shifts. We considered randomly sampled reference states but retained constant references because these tasks already expose the forecast–control discrepancies under investigation. Generalization across reference states remains untested.
FNO comparison. We compare complete training configurations under an approximate budget of 12 hours per dynamics model on one A100. FNO₁ and FNO₅ share the architecture and source trajectories, with identical policy-training and evaluation horizons. Their subscripts denote the dynamics-model supervision horizon.
FNO₅ penalizes prediction errors across five autoregressive steps and backpropagates through predicted states, accounting for accumulated rollout error. We selected optimization settings for each objective within the computational budget. Both configurations showed little further loss reduction toward the end of training under their respective schedules. This supports the chosen training durations. Persistence under identical optimization and checkpoint-selection settings remains untested, so we attribute the results to the complete configurations.
FNO₅ achieves the lowest nominal terminal tracking error on five of six PDEs and comes within approximately 7% on the sixth. Its advantage does not extend to every perturbation setting: under the largest tested CH perturbations, the policy trained through FNO₅ fails from some initial conditions, while the FNO₁ policy retains tracking.
PPO comparison. PPO uses the same tracking and control-effort stage cost as DPC, with the same targets, actuator bounds and evaluation horizons. We initially targeted approximately 12 hours of PPO training and extended runs where needed to allow training to stabilize. Recorded CPU training times range from 8.57 to 36.52 hours.
FNO₅-based DPC achieves lower terminal tracking error than these PPO policies on all six PDEs, by 0.94–3.72 orders of magnitude. This comparison includes the PPO runs that received additional training beyond the intended budget. The timings document the resources used; CPU and A100 hours do not establish equivalent total compute.
Connection between theory and experiments. Could you clarify which theoretical inference you consider unsupported, and whether your concern is with the derivation itself or its use in interpreting the empirical results? A reference to the relevant statement or proof step would help us address this precisely.
TI-DON failure on Cahn–Hilliard. We agree that the current evidence does not separate the causal roles of Jacobian error, closed-loop distribution shift and policy optimization. TI-DON’s poor tracking within its own surrogate shows that transfer to the numerical plant alone cannot explain the failure. The observed state-sensitivity mismatch does not establish the cause.
We are running a targeted policy-training experiment on two additional, independently trained TI-DON dynamics models. We reduce the policy learning rate to one-third of its original value while holding policy initialization, update budget and other settings fixed. This tests sensitivity to that optimization choice; it does not fully separate the competing mechanisms.