- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
Paper proposes SAO for predicting boundary-driven dynamics which combines attention across temporal Fourier modes with query-dependent and method is evaluated on Burgers and 1D hemodynamics problems.
Critical strengths
- The results show improvements in multi-frequency Burgers problems and hemodynamic flow-rate prediction.
Critical weaknesses
- Limited Novelty as lots of work already exists on spectral attention [1] and baseline comparison with recent work such as Transolver, Latent Mamba Operator, and Latent Neural operator.
[1] Yang, Zherui, et al. "Simple yet Effective: Low-Rank Spatial Attention for Neural Operators." arXiv preprint arXiv:2604.03582 (2026).
-
Experiments cover only single artery and fixed Y-bifurcation. Generalization to larger networks or unseen geometries is not shown.
-
Some component benefits are less general than main motivation. A well-chosen fixed cutoff matches or slightly outperforms the learned gate, and spatially varying FiLM gives no clear overall improvement.
-
Burgers benchmarks change both the number of inlet frequencies and the RMS amplitude making it difficult to isolate the benefit of attention.
Questions for authors
-
Could you clarify novelty relative to existing spectral attention literature and conditioned neural operators? Also how does it performs wrt to it? See weakness 1. The paper is not ready for acceptance in its current form.
-
Would cross-mode attention still provide similar gains if Burgers experiments kept inlet RMS amplitude fixed while varying the number of frequencies?
-
How does SAO compare with simpler model using parameter-conditioned FiLM and validation-selected fixed spectral cutoff?
-
Could you evaluate on a larger vascular network or explain what changes would be needed to handle unseen geometries and topologies?
-
Temporal functions depend on each query, how do inference time and memory scale with the number of spatial locations?
5 comments
Thank you for the rebuttal. I will maintain my score.
Thank you for your reply. Could you please clarify your remaining concerns after our responses? We would appreciate any feedback on points that we have not adequately addressed, and we would be happy to discuss with you before the rebuttal period ends.
We thank the reviewer for the sharp comments and constructive suggestions.
W1/Q1. Relations to other attention-based operators. We agree that attention is widely used in neural operators. However, compared with our work, most of this existing work targets different problems (Introduction, Lines 54-59) and apply attention in a different way. LRSA, Transolver, LNO and LaMO form tokens from spatial points and mix among them, by attention or, for LaMO, by a state-space scan, to predict spatial fields. In contrast, SAO targets boundary-driven problems and applies attention in the temporal spectral domain, whose tokens are the temporal Fourier modes below a learned cutoff, and every retained mode attends to every other with weights computed from the inlet (Section 3.3, Appendix E.3). Nonlinear propagation moves signal energy across temporal frequencies in a way set by the inlet (Introduction). A standard Fourier layer applies weights fixed after training, whereas the attention computes the mode coupling from the current activation and so adapts to the inlet (Section 3.3).
We will add the listed references.
W2/Q4. Testbeds and larger networks. Single vessels and bifurcations are standard benchmarks for 1D arterial models (Boileau et al., 2015; Xiao et al., 2014) and common testbeds for learned surrogates (Kissas et al., 2020).
Our work focuses on learning boundary-driven wave responses, rather than generalization across vascular topologies. Extending SAO to larger networks would require additional mechanisms for representing connectivity and coupling vessel responses (Pegolotti et al., 2024). SAO could serve as a building block for such an extension, but developing and evaluating that framework is beyond the scope of this study and a promising direction for future work.
W3. Component benefits: Gate, FiLM. We disagree with this weakness. We demonstrated clear benefits of the main components of SAO including learnable gates and FiLM.
In Appendix G.1, we show that learnable gates can be used for automatic selection of modes through gradient descent. Without gates, one has to select modes based on hyperparameter tuning on validation data, which is very time-consuming. "A well-chosen fixed cutoff", mentioned by the reviewer, is actually determined by learnable gate (see Appendix G.1).
The benefit of FiLM has been demonstrated in Section 4.3 (line 435). Without FiLM, SAO-noFiLM increased the error by 24, 11, and 2.7 times on B1-B3, 5.6 times on H1 and 3.4 times on H2 (three-field mean, Table 4.2), compared with SAO.
Q3. A simpler model for comparison. As the reviewer suggested, we trained a simpler model, FNO-T+FiLM. It is based on FNO-T (Appendix H.1) with FiLM applied after every layer from the query c=(x,μ). Modes are validation-selected using fixed cutoff (101 for both cases). The table below shows SAO retains substantially lower errors than FNO-T+FiLM.
W4/Q2. Matched inlet RMS. We added three new Burgers sets with 1, 10 and 20 sinusoids rescaling each realization to B2's expected inlet root mean square (RMS) (0.9309), across three seeds. At fixed RMS attention reduces the error more than 4 times at all cases.
Q5. Scaling with the number of locations. SAO runs its Dynamic Net once per queried location, so time and memory grow with the number of locations (Appendix E.4). The table gives one H1 simulation on one H100, with all locations in one pass. Time stays near 3 ms up to a few hundred locations, since the GPU processes them in parallel, and then grows linearly. Memory grows linearly with the number of locations. Even at 3,000 locations, SAO takes 18.0 ms, against 0.75 min for the solver (Table 4.5). Similar behaviors are observed in H2. We will add this analysis to Appendix G.2.
References.