- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces SDC, which augments frozen pretrained neural operators with low-rank spectral updates and nonlinear bottleneck modules to learn state-dependent prediction corrections through supervised training. The authors evaluate autoregressive forecasting performance on spherical shallow-water dynamics, WeatherBench weather forecasting, and planar Navier–Stokes flows. They also conduct state–correction pairing experiments to examine whether the learned corrections depend on the current input state.
Critical strengths
-
Experiments span multiple forecasting tasks. The method improves upon the corresponding backbone models on spherical shallow-water dynamics, WeatherBench weather forecasting, and planar Navier–Stokes flows. Results for WeatherBench and planar FNO are reported across three random seeds.
-
A comparison at similar computational cost supports the performance gains. In the shallow-water experiments, SDC reduces the average 5-hour and 10-hour forecast errors by 13.3% and 14.4%, respectively, relative to a GSNO trained for 60 epochs, with a comparable end-to-end runtime.
-
Diagnostic experiments support the input dependence of the learned corrections. On 500 test states, correctly pairing each state with its learned correction reduces the single-step error by approximately 34.7%. Shuffling these pairings increases the error above the backbone baseline, indicating that the corrections contain state-specific information.
Critical weaknesses
-
Insufficient differentiation from LoRA and adapter tuning. The proposed method combines low-rank spectral updates with nonlinear bottleneck adapters. However, the paper lacks comparisons with standard LoRA and adapter tuning under matched parameter budgets, as well as separate ablations of the two correction branches. This makes it difficult to identify the added value of the proposed design.
-
Insufficient validation of the motivation for state-dependent correction. FNOs are already nonlinear models with state-dependent local responses. Although the state-shuffling experiment demonstrates that the learned corrections depend on the input, it does not establish that the underlying errors primarily arise from shared spectral weights. Perturbation-response experiments or Jacobian analyses would help substantiate this interpretation.
-
Insufficient evidence of long-horizon rollout stability. The experiments primarily evaluate 10–20-step rollouts, leaving error accumulation over longer horizons insufficiently examined. The theoretical bounds assume uniformly bounded one-step errors and still permit error amplification over time. The results therefore support improved accuracy within the evaluated horizons, while longer-term stability remains unverified.
Questions for authors
see Weaknesses.
4 comments
2. Validating the Motivation: Error Attribution, Perturbation, and Jacobian Analysis (Weakness 2)
We appreciate the reviewer's careful consideration of the theoretical motivation. As noted in Section 3.2 (Eq. 4) and Appendix A.4, the complete GSNO/FNO network is already nonlinear and state-dependent through its pointwise activations and bypass paths. Our statement concerns specifically the nonlocal spectral propagation weights ( in Eq. 3 and in Eq. 61), which are statically shared across input states, as clarified in Figure 1 and Section 3.2.
To further examine the mechanisms, we paired the retrained ablations above with hidden-state perturbation / directional-derivative diagnostics and post-training branch interventions on the trained checkpoint (with all parameters fixed):
| Diagnostic / Inference Intervention Setup | Evaluated Metric | Empirical Result |
|---|---|---|
| Frozen GSNO-50 Reference | One-step MRE (50 fixed test states) | 0.041465 |
| Full SDC (Both branches active) | One-step MRE (50 fixed test states) | 0.028816 |
| Spectral Path Only (Bottleneck disabled at inference) | One-step MRE (50 fixed test states) | 0.066268 |
| Bottleneck Only (Spectral path disabled at inference) | One-step MRE (50 fixed test states) | 0.058117 |
| 1% Hidden-State Perturbation (Directional derivative ) | Relative change in correction output | 14.65% (mean over 16 states) |
- Shared Spectral Weights as the Dominant Source of Improvement: In the retrained ablations (Section 1), updating the statically shared spectral weights alone (
Spectral-Only) captures 73.6%–80.0% of the total multi-step error reduction, whereas training the bottleneck alone without recalibrating the shared spectral weights yields minimal gain (0.1492090.147647). - Co-Adaptation vs. Independent Ablations: While
Spectral-Onlycaptures most of the gain when trained independently, disabling either branch at inference time after joint calibration increases one-step MRE (0.066268and0.058117) above the uncorrected GSNO-50 baseline (0.041465). This is expected: the retrained ablations measure what each path can learn alone, whereas the inference intervention shows that both paths co-adapt and operate jointly in the calibrated solution. - Perturbation & Jacobian Verification of State Sensitivity: Applying a 1% relative perturbation to the hidden state before the first propagation block changes the fixed-parameter SDC correction output by 14.65% on average in relative norm (Eq. 12 & Eq. 65). Combined with the state-shuffling diagnostic (Table 2 & Appendix A.11), this confirms that the learned correction actively responds to the current state rather than acting as a fixed residual field.
The distinction and diagnostics have been included in Section 3.2 and Appendices A.13–A.14.
3. Extended Rollout Stability & Theoretical Bound Scope (Weakness 3)
We thank the reviewer for raising this important point regarding long-horizon stability. In Appendix A.9 (Eq. 81–91), the finite-horizon bound formalizes how reducing the one-step defect scales down the error envelope over finite horizons . We agree that when , this bound permits error growth over time and does not claim unconditional asymptotic () stability; the finite-horizon scope is stated in Appendix A.9.
To examine error accumulation well beyond 10–20 steps, we evaluated a 30-hour (30-step) closed-loop rollout across 50 fixed SWE test trajectories under 1-hour autoregressive feedback:
| Model | 5 h MRE | 10 h MRE | 20 h MRE | 25 h MRE | 30 h MRE |
|---|---|---|---|---|---|
| GSNO-50 (Frozen Backbone) | 0.130823 | 0.176216 | 0.249893 | 0.293381 | 0.332341 |
| Full SDC (Ours) | 0.110880 | 0.153173 | 0.215810 | 0.252171 | 0.283806 |
Both models remain stable through 30 autoregressive steps without entering a runaway regime, and Full SDC consistently maintains lower error across all horizons, reducing 30h MRE by 14.6% relative to the frozen GSNO-50 backbone. The extended rollout evaluation has been highlighted in Appendix A.16.
We sincerely thank the reviewer again for the constructive comments and valuable suggestions. We have incorporated the additional experiments and analyses into the revised manuscript, especially the parameter-matched adaptation comparisons, component-wise ablations, state-sensitivity diagnostics, and extended 30-hour rollout evaluation.
Thank you for your response and clarifications. While I consider the proposed method a reliable approach, my concern about its limited novelty remains, so I will maintain my original score.
We sincerely thank you for your further feedback and for recognizing the reliability of our approach. We understand your remaining concern regarding the novelty.
To further address your concern and build on the reviewers' constructive suggestions, we have further strengthened our work through additional operator-level theoretical analysis and new matched multi-step experiments. These findings clarify how SDC's complementary correction mechanisms interact with closed-loop optimization and demonstrate that its architectural advantage persists over generic residual and spectral-only adaptations under the same multi-step training objective. Importantly, these results further strengthen the methodological novelty of SDC by highlighting its structured, operator-aligned correction mechanism, whose benefits extend beyond generic residual adaptation and remain evident under closed-loop optimization.
For further details, please refer to our response to Reviewer fQSt, entitled "Further Clarification of SDC's Methodological Novelty and New Multi-Step Validation", as well as Sections 4 and Appendix A.19-20 of the revised manuscript, where the relevant theoretical analysis and experimental results have been incorporated and highlighted in red.
We hope these additional findings help address your concern and would greatly appreciate your reconsideration of the overall assessment.
We sincerely thank the reviewer for the constructive feedback. We appreciate the reviewer's recognition of the broad experimental evaluation, favorable accuracy–efficiency trade-off, and diagnostic evidence supporting state-dependent corrections.
1. Differentiation from Matched LoRA/Adapter Controls & Branch Ablations (Weakness 1)
We thank the reviewer for this valuable suggestion. We agree that comparisons with parameter-matched adaptation methods and individual correction components are important for evaluating the contribution of SDC. We have evaluated independently retrained branch ablations (
Spectral-Only, Eq. 64;Bottleneck-Only, Eq. 65) alongside two parameter-matched PEFT controls under the identical 50-epoch calibration schedule across three seeds:115,520real scalar degrees of freedom (DOF).114,688real scalar DOF, within0.72%of SDC).Comparison with Matched PEFT Controls: Full SDC consistently achieves lower rollout error than both the DOF-matched generic residual adapter and the spectral LoRA at 5h and 10h.
Branch Contributions: Recalibrating the shared spectral weights (
Spectral-Only) accounts for 73.6% of the total 5h MRE reduction and 80.0% of the 10h reduction. Combining the compact 832-DOF state-conditioned bottleneck with the spectral path provides the remaining 26.4% (5h) and 20.0% (10h) reduction (0.119134→0.108345at 5h;0.120879→0.112183at 10h) and reduces cross-seed standard deviation by nearly an order of magnitude (±0.006632→±0.000878).The matched controls and branch ablations have been highlighted in Appendix A.13.