- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces DS4D-FFNO, which combines FFNO’s spatial modeling with DS4D’s retrieval of past hidden states at learnable delays to predict PDE dynamics with fixed-delay boundary feedback. The authors evaluate its autoregressive forecasting performance on six PDE benchmarks with delayed boundary feedback and six without physical delays. They also examine the model’s reliance on the learned delays by permuting them across channels or replacing them with random values.
Critical strengths
-
The architecture is well aligned with the task requirements. FFNO models spatial interactions, while DS4D stores and retrieves historical hidden states to capture delayed dependencies. Interpolation enables retrieval at non-integer delays and allows the delay parameters to be learned through end-to-end training.
-
The experiments cover multiple physical systems and evaluation criteria. The authors compare the method with seven baselines on six PDE tasks with delayed boundary feedback and conduct supplementary evaluations on six tasks without physical delays. Results are reported over three training seeds and include full-field and boundary-region errors, alongside predicted-field visualizations and error curves over the forecast horizon.
-
The study includes targeted comparisons and diagnostic experiments. DS4D-FFNO achieves lower mean full-field errors than S4-FFNO on all six delayed tasks under a controlled setup with the same spatial backbone, initialization of shared components, and training batch order. Delay permutation and random replacement experiments assess the trained model’s reliance on its learned delays, while additional experiments examine sensitivity to spatial resolution and model parameters.
Critical weaknesses
-
Limited differentiation from prior work. MemNO [1] already places a temporal memory layer between two pairs of FFNO layers, while hidden-state caching, learnable delays, and interpolated retrieval originate from DSSM [2]. The contribution beyond replacing the temporal module and adapting it to PDEs with delayed boundary feedback needs clarification. Comparisons with known physical delays or fixed delay banks would help establish the value of learning delay locations.
-
Baseline comparisons partly confound history access with retrieval design. The proposed model uses 192 historical frames for 1D tasks and 96 for 2D tasks, whereas FNO, FFNO, and Transolver use only the current frame. Although S4-FFNO provides a more direct comparison, simpler baselines using the same history window, such as frame concatenation or temporal convolutions, are needed to isolate the benefits of DS4D’s retrieval mechanism.
[1] R. Buitrago Ruiz, T. Marwah, A. Gu, and A. Risteski, “On the Benefits of Memory for Modeling Time-Dependent PDEs,” in International Conference on Learning Representations (ICLR), 2025.
[2] Y. Qian, S. Chen, J. Liu, S. Cai, and C. Xu, “DSSMs: State Space Models with Explicit Memory via Delay Differential Equations,” arXiv preprint arXiv:2607.10244, 2026.
Questions for authors
see Weakness.
2 comments
Thank you for the helpful clarifications, which have adequately addressed my concerns. I will maintain my current score.
Response to Reviewer PMPe
We thank the reviewer for asking us to clarify the contribution and to test simpler temporal models with the same history window.
Thank you for this comment. We agree that our contribution needs clearer explanation. The suggested comparisons with the known physical delay and a fixed delay bank are reported in Tables 1 and 2, respectively. DS4D-FFNO has lower mean error than the fixed physical-delay variant on all six tasks, and it outperforms the fixed uniform-bank variant on five of the six.
Contribution. Building on MemNO and DSSM, we adapt and evaluate learned hidden-state retrieval for PDEs with delayed boundary feedback. Our contributions are as follows:
Modeling delayed dependencies explicitly. DS4D-FFNO retrieves past hidden states within its temporal update, and each channel learns its retrieval locations jointly with the memory dynamics. This gives the model an explicit mechanism for capturing delayed dependencies.
Forecasting without a supplied physical delay. In practice, the physical delay is often unknown or hard to estimate accurately. DS4D-FFNO is designed for this setting, as it forecasts PDEs with delayed boundary feedback directly from observed field histories without taking the physical delay τ as an input.
An architecture aligned with PDEs with delayed boundary feedback. Such PDEs combine spatial interactions with feedback from past boundary states. DS4D-FFNO reflects this structure by coupling FFNO spatial mixing with delayed retrieval from grid-wise hidden-state histories. The retrieved information enters the temporal update and is then mixed across the field, so the model can represent how delayed feedback affects later field evolution.
Together, these contributions provide a framework for forecasting delayed PDEs from observed field histories and characterize how retrieval design affects prediction.
Thank you for requesting comparisons with simpler baselines using the same history window. We evaluate three temporal-convolution variants with comparable parameter counts and report the results in Table 12 below. We believe these are meaningful controls for assessing the value of learned retrieval and will include them in the paper.
Table 12. Temporal baselines with matched parameter counts. TemporalConv-FNO, TemporalConv-FFNO, and TemporalConv-Transolver are evaluated under the same protocol as DS4D-FFNO, with parameter counts differing by at most 0.15%, 0.05%, and 1.12%, respectively. All runs use 120 epochs for 1D tasks and 60 for 2D tasks.
DS4D-FFNO has lower mean error than all three temporal variants on all six tasks. Even when simpler temporal variants are given the same history window, DS4D-FFNO remains more accurate.