- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies the output discrepancy of a fixed FNO evaluated on two nested grids representing the same input. For a one-dimensional, single-Fourier-layer model with linear lifting/projection, H^s input with s > 3/2, Lipschitz activation, and bounded parameters, it gives a common-grid pointwise bound proportional to (1 - N/M)/N. This bound is uniform in the finer resolution M and vanishes as the base resolution N increases. An appendix transfers it to squared residuals evaluated on the common coarse grid. Experiments use two synthetic inputs, 100 random parameter choices, and one to four layers to illustrate base-grid convergence and apparent saturation with increasing refinement.
The intended estimate is recoverable by a short quadrature argument. However, the central coefficient proof is missing, the stated real-valuedness condition is incorrect for channel matrices, and the smooth single-layer experiment should have zero mismatch in exact arithmetic. Theoretical novelty relative to existing discretization analysis is also limited.
Critical strengths
-
An explicit and interpretable consistency estimate. The formula separates base resolution from refinement ratio and makes the dependence on activation, input regularity, mode cutoff, and parameter bounds visible. This can help distinguish implementation mismatch from target-operator approximation error, provided the narrow single-layer scope is maintained.
-
A clean comparison at shared physical points. Holding the input function and parameters fixed avoids mixing discretization effects with retraining or interpolation choices. The paper also acknowledges that its discontinuous input falls outside the theoretical regularity regime. These choices give a reasonable starting point for a focused analysis.
Critical weaknesses
-
Limited theoretical novelty and scope. Lanthaler et al. (2024), Remark 4 and Theorem 5, already imply refinement-uniform common-grid and reconstructed L2 discrepancies under smooth-activation assumptions, by a triangle inequality through the continuous model. The submission allows merely Lipschitz activations, but analyzes only one layer; its explicit ratio factor follows from elementary paired quadrature for any integer refinement. Under its stated Sobolev assumptions, standard aliasing estimates also yield faster base-grid decay for this one-layer model. The work does not analyze repeated nonlinear aliasing in deep FNOs or establish why the new estimate is consequential beyond existing theory.
-
Incomplete proof and unresolved empirical validation. Appendix B.3 does not contain the proof of the key Lemma 3.4. Moreover, the smooth test input has Fourier support only at +/-1 and +/-2, fully resolved on all tested grids. For the defined T = 1 architecture, all retained coefficients and common-point local terms therefore agree exactly, so the mismatch is zero in exact arithmetic for every parameter choice. The nonzero curves in Figures 1a and 2a require reconciliation with sampling, precision, and implementation before they can support the claimed behavior. The discontinuous-input and multilayer tests are outside the theorem. Together these issues leave no convincing nontrivial numerical validation within the stated setting.
Questions for authors
-
Can you provide the intended proof of Lemma 3.4, replace the duplicated Appendix B.3, and state all assumptions used? Please also clarify whether the matrix symmetry condition was intended to mean entrywise conjugation rather than the explicitly defined conjugate transpose.
-
How do you explain nonzero T = 1 mismatch for the band-limited smooth input? Please provide the exact sampling/restriction operations, full implemented architecture, activation, parameter initialization, dtype, and code revision. Do float64 and exact-Fourier-coefficient controls give zero up to roundoff? A smooth input with a nonzero unresolved spectral tail would provide a nontrivial test of the theorem.
-
What substantive theoretical conclusion is new beyond existing continuous-versus-discrete convergence results and standard quadrature/aliasing estimates? Please distinguish the weaker activation assumption and explicit ratio factor from the broader refinement-uniform conclusion, and justify the suggestion that whole-domain L2 comparison causes refinement-dependent growth.
-
Is Theorem C.2 intended only for fine outputs restricted to the coarse grid? Its loss uses an unnormalized sum over common points and is not the ordinary fine-grid training objective. Please state precisely what training-related conclusion, if any, follows from it.