- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes the Spectral Generator Neural Operator (SGNO) for long-horizon autoregressive PDE prediction. SGNO combines a fitted linear propagation branch in Fourier space with a neural corrector that learns the dynamics not captured by the linear map. The corrector uses a spectral generator parameterization inspired by exponential integrators. Across 13 periodic PDE configurations (nine linear and four nonlinear), the authors report near-exact predictions on the linear tasks and 13–74% lower 100-step rollout error than the strongest evaluated baseline on each nonlinear task.
Critical strengths
- The paper is clearly written, and the motivation, method, and experimental setup are easy to follow.
- The experimental reporting is thorough and transparent, including results across multiple seeds, failed runs, and limitations of the numerical reference solutions.
- SGNO achieves the lowest median rollout error among the main baselines on all four nonlinear tasks.
Critical weaknesses
-
The ablations do not sufficiently isolate the contribution of the corrector design. The “Fixed identity” variant in Table 2 shows that the correction branch alone already outperforms the strongest baseline on three of the four nonlinear tasks, but the contribution of its specific architectural choices is less clear. Comparisons with reasonably tuned FNO or convolutional correctors, using the same fitted propagation branch and comparable parameter counts and computational costs, would help clarify this contribution. Further controls could compare shared versus independently parameterized weights for the two paths, and include a residual-parameterized FNO baseline to separate the correction-layer design from the residual formulation.
-
The conditions under which SGNO is effective remain insufficiently characterized. Although the paper acknowledges the scope of its evaluation in Section 6, it remains unclear how the benefits depend on the amount of training data and the dynamics of the PDE. Table 2 shows varying gains from fitted propagation across tasks, while Table 1 shows the smallest improvement over the strongest baseline on Kolmogorov flow. These differences warrant further characterization. Experiments varying the number of training trajectories, together with comparisons across PDEs with different dynamical or spectral properties, would help identify when fitted propagation provides substantial benefits and when those benefits are limited.
Questions for authors
The main requests are in the Weaknesses section. The following clarifications would also be helpful; additional experiments are welcome but not expected for every question.
-
Could the authors clarify how SGNO differs from the cited SSNO in practice? If feasible, a performance comparison on a shared task such as KS would also be useful.
-
How sensitive is SGNO's performance to the corrector's capacity, and does fitted propagation continue to provide an improvement as that capacity increases? A discussion or any available evidence would be helpful.
-
Appendix A2.2 states that FNO, CNO, and KNO “retain their recorded evaluations.” Could the authors clarify whether these baselines used the same training budget, seed protocol, and data ordering as SGNO?
8 comments
Response to Reviewer 3XiH (2/5)
W2a. Conditions under which fitted propagation helps
The conditions under which SGNO is effective remain insufficiently characterized. Although the paper acknowledges the scope of its evaluation in Section 6, it remains unclear how the benefits depend on the amount of training data and the dynamics of the PDE. Table 2 shows varying gains from fitted propagation across tasks, while Table 1 shows the smallest improvement over the strongest baseline on Kolmogorov flow. These differences warrant further characterization. Experiments varying the number of training trajectories, together with comparisons across PDEs with different dynamical or spectral properties, would help.
Fitted propagation helps the most when the state changes contain clear/repeatable modal propagation laws, and this benefit persists with five times fewer training trajectories. We first state the conditions under which effectiveness has been demonstrated and explain the differences between tasks in the original tables. We then report the two experiments on the dynamics and on the amount of training data that the reviewer suggests.
-
SGNO has the lowest median prediction error among the compared strong baselines in all 13 PDE configurations in one to three dimensions of the original manuscript, with particularly large gains on the linear tasks. These tasks use periodic boundaries, fixed grids and fixed observation intervals, and they cover propagation, diffusion, dispersion and nonlinear interactions.
-
The high accuracy on the linear tasks reflects the design goal of SGNO, which is to identify propagation laws from data and so to establish an accurate starting point for long-term prediction. For the periodic linear tasks with constant coefficients studied here, the Fourier modes evolve independently. Each step can be described by a complex multiplier, whose magnitude gives the amplitude change and whose angle gives the phase advance. SGNO fits these multipliers from adjacent training states and so learns directly how each mode evolves. Because the true update has exactly the form that the propagation branch can represent, the fit recovers the propagation laws of the modes excited by the training data, which gives a very low long-term error.
-
Nonlinear tasks also involve interactions between frequencies, so the corrector has to learn state-dependent changes. The full SGNO reaches its accuracy through joint learning of propagation and correction, and the additional benefit of fitted propagation depends on how much of the evolution these modal updates can describe accurately. This explains the varying gains in Table 2. In KdV, linear dispersion advances the phases of different frequencies at different rates. The fitted propagator estimates this pattern from adjacent observations and provides an accurate starting point, while the corrector captures the nonlinear changes. These dynamics match the representation of the propagation branch well. Nonlinear transport in Burgers is different. The local propagation speed depends on the state and the waveform steepens, and fixed modal multipliers cannot fully describe these changes. Accordingly, fitted and identity initialization give similar results after joint training in the original Burgers setting. Adding a global translation at constant speed introduces a component that modal phase advances describe accurately, and the advantage of fitted initialization then increases. The controlled experiment below tests this effect directly.
-
The state-dependent changes in Kolmogorov flow are more complex. It is a two-dimensional incompressible Navier-Stokes flow driven by periodic forcing, and its vortices evolve continually through nonlinear transport, viscous dissipation and forcing. These changes require propagation and correction to be learned jointly, and they make long-term prediction more challenging. The strongest baseline on this task in Table 1 is CNO, whose original paper uses Navier-Stokes as an important validation task and shows strong predictive performance [2]. SGNO still lowers the error from 0.494 for CNO to 0.430, a reduction of about 13.0%. The relative gain on this task should therefore be read in the light of the complex flow dynamics and the strong baseline. SGNO improves the accuracy on this task as well, and it covers a broader range of dynamics within the same framework.
Response to Reviewer 3XiH (3/5)
W2b. Controlled experiments
Following the reviewer's suggestion, we added two controlled experiments that examine how the composition of the dynamics and the amount of training data affect the benefit of fitted propagation.
In the control on the dynamics, we add a global translation at speed 0.25 to the same Burgers system and keep the initial states, viscosity, grid and time interval fixed. This preserves the original waveform evolution and the spectral amplitudes and adds an explicit linear transport component. Both initializations use the same data, corrector, data order and update budget. The table gives means over the same five training seeds.
| Burgers, GMean100 | Fitted initialization | Identity initialization |
|---|---|---|
| No added transport | 0.00360 | 0.00356 |
| Added linear transport | 0.00218 | 0.00801 |
Without added transport, the two initializations have similar errors. With added linear transport, fitted initialization lowers the error by 72.7% and improves all five seeds. Extending to ten seeds gives mean error reductions of 72.0% and 74.5% in the early and the late window, both with 10/10 paired improvements. Adding explicit linear transport to the original nonlinear evolution therefore substantially increases the advantage of fitted initialization.
In the control on the amount of data, we take the same Burgers task with added transport and reduce the training trajectories from 50 to a fixed nested subset of 10. Both initializations use the same data, data order, 10,000 updates and five training seeds, so the amount of data is compared under a fixed training budget.
| Training trajectories | Fitted initialization | Identity initialization | Error reduction | Paired improvements |
|---|---|---|---|---|
| 10 | 0.00279 | 0.00991 | 71.9% | 5/5 |
| 50 | 0.00218 | 0.00801 | 72.7% | 5/5 |
The values are means of GMean100 over training seeds 0 to 4, with the data subset fixed. With one fifth of the training trajectories, fitted initialization still lowers the error by 71.9% and improves all five seeds. Under the tested transport dynamics, the additional benefit of fitted propagation therefore persists with less training data.
Revision location: Table 3 and Appendix A4.4 give the control on the dynamics, Appendix A8.2 (Table 26) gives the control on the training data, and Appendix A8 explains the task-dependent benefits.
Response to Reviewer 3XiH (1/5)
Response to Reviewer 3XiH
We thank the Reviewer for the comments.
Summary Response:
W1. Contribution of the corrector design
We added the three sets of controls that the reviewer suggests, and each of them supports the corrector design. They replace the corrector under the same propagation branch, add a residual FNO, and compare shared with independent parameterization. They examine the corrector architecture, the residual formulation and the parameter efficiency, respectively. These controls are new runs under one common training protocol, with identical data within each comparison, and they are reported separately from the main-table results.
First, we replaced the corrector by parameter-matched FNO and CNN correctors under the same fitted propagation branch. On Kolmogorov flow, the three models use the same data and training budget and differ only in the corrector. The SGNO, FNO and CNN versions have 106,010, 104,924 and 105,889 parameters.
Second, we added a residual FNO to separate the architecture from the residual formulation. Both models use the same outer identity map, so both predict the input plus a learned update. This isolates the correction architecture within a residual formulation.
Third, we compared shared with independent parameterization. We replaced the shared generator of the two spectral paths by independent parameters and kept all other settings fixed.
Revision location: Section 5.2 summarizes these controls. Appendix A4.5 (Tables 16 to 18) reports the corrector replacement, the residual form and the parameter sharing, and Appendix A2.3 specifies their protocols.