- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposed an extension of the MemNO framework from Buitrago Ruiz et al., 2025, namely Adaptive Memory Gate FNO (AMGFNO). The novelty of this paper is the adaptive gating of the memory, which includes two gates: one that is content-driven and one that is driven by a precomputed frequency statistic. Additionally, the paper provides a theoretical analysis from a squared-loss Bayes perspective, showing how unresolved spectral energy relates to the potential benefit of using history for an ideal predictor. In 17 out of the 20 settings, AMGFNO is the best or tied. Five baseline models are included, along with the MI-FFNO variant. However, most of these baselines are pre-2024 and a bit outdated for now, given that there are many stronger models available.
Critical strengths
-
The problem is a well-formulated extension of the Buitrago Ruiz et al., 2025 paper from “whether we need memory” to “how much memory we need.” Based on this paper and previous works, this can be affected by several factors such as the resolution, signal-to-noise level, and the underlying problem itself. Hence, I found the adaptive perspective important.
-
All experiments seem well-conducted, with proper ablations, multi-seed results, comparisons across different memory layers, and analysis of the additional computational cost.
Critical weaknesses
-
Although several baselines are provided, most of them are pre-2024. However, given the specific claim of the paper and the inclusion of S4FFNO as the direct baseline, I find this understandable.
-
The novelty of the method itself is limited. I found the formulation to be heavily incremental over MemNO, and the content-dependent gating strongly resembles GRU-style gating. The frequency-aware part is more specific to this paper, but the overall architectural change is still relatively small.
Questions for authors
None. I am very familiar with this research area, and the authors have already addressed all the potential questions I had in the paper. The only factors preventing me from giving a clear accept are the points mentioned under Critical Weaknesses. However, if the paper turns out to be borderline, I would be willing to argue in favor of it.
We thank Reviewer zMRQ for the careful reading and for the willingness to support the paper.
Response to W1: Recent Baseline
We ran DPOT (Hao et al., ICML 2024), a transformer-based neural operator, as a baseline; the results are below. AMGFNO has lower nRMSE in all nine KS settings. DPOT is implemented in 1D and trained from scratch, without pre-training, with the same protocol and a similar parameter count as the other baselines; all models receive only the initial state at test time (Appendix C.4). S4FFNO remains our direct baseline for assessing adaptive memory fusion.
KS, rollout nRMSE (mean ± std over 3 seeds).
Response to W2: Novelty
Our contribution is the step from “whether memory is needed” to “how much memory is needed”. The frequency-aware gate scales the memory weight by the unresolved spectral energy of the observation condition, the same quantity that appears in the bounds of Eqs. (8)–(9). This factor cannot be replaced by a generic learned gate: with a learned scalar in its place, the gate stays at 0.34–0.39 regardless of the resolution and the error is 11–36% higher (
Appendix E.5). Three results support the step to “how much memory". Empirically, the best fixed memory weight varies from 0 to 0.75 across KS resolutions and viscosities. Theoretically, Proposition 1 and Eqs. (8)–(9) relate the Bayes history gain to resolution and unresolved spectral energy. Practically, the gate lowers nRMSE in 38 of the 45 settings across five memory layers, including all 15 at 𝑓=32 (Table 3), with only 0.3–1.1% more parameters (Appendix I).