- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents a well-motivated recurrent architecture that models spatial information exchange and temporal memory through a discretized first-order damped wave system on a grid. Its hidden state consists of a primary scalar field and two auxiliary velocity fields. Each transition combines backward-gradient/forward-divergence propagation with implicit damping, followed by input injection and a pointwise nonlinearity on the primary field. Spatially varying propagation and damping coefficients are trained end-to-end.
The block-operator formulation cleanly separates fixed local topology from trainable dynamical fields, giving the physical formulation a concrete architectural role. The evaluation covers three sequence-classification tasks and three PDEBench forecasting tasks, supported by component ablations and an analysis of the linear transition operator. The strongest reported results occur on SHD, reaction diffusion, and shallow-water prediction, while other tasks show more limited benefits. The authors provide substantial experimental work and generally careful qualification of their findings. The main unresolved issue is whether the observed advantages can be attributed specifically to the proposed local wave dynamics and their alignment with meaningful data topology.
Critical strengths
-
Interpretable and substantively structured design. WO-RNN separates a fixed sparse gradient divergence topology from trainable propagation and damping fields. The explicit recurrence and block-operator formulation make this architectural constraint transparent and provide a useful framework for studying structured recurrent dynamics. Retaining explicit neighbor interactions is a meaningful design choice, even though its practical advantage over closely related alternatives requires further evidence.
-
Substantial empirical scope and careful claim calibration. The evaluation spans sequence classification and spatial forecasting, with useful ablations showing that both spatial coupling and modulation affect performance. The paper also reports less favorable results on visual sequences and compressible CFD. It explicitly acknowledges that the experiments do not establish topology alignment, isolate the benefit of coefficient heterogeneity, or prove global nonlinear stability. These qualifications strengthen the credibility of the reported observations.
Critical weaknesses
-
The evidence does not sufficiently isolate the distinctive contribution of the proposed dynamics. The paper lacks a direct comparison with BioOSS, a closely related wave-inspired state-space model. For PDE forecasting, the reported implementation also includes a multiscale architecture whose contribution is not separated from that of the wave update. Removing propagation establishes that coupling matters within WO-RNN, but does not demonstrate an advantage specific to its wave formulation. This limits the evidence for the paper’s central methodological contribution.
-
The topology-alignment interpretation is insufficiently supported, and the key SHD comparison remains uncertain. The unrestricted input projection does not explicitly preserve cochlear-channel adjacency, and no evidence establishes that meaningful alignment emerges during training. Both modulation and spatial coupling substantially affect SHD performance, so the gains cannot be attributed specifically to topology alignment. Moreover, the reported advantage over the strongest listed LSTM configuration is only 0.70 percentage points, all experiments use one seed, and the validation procedure for SHD hyperparameter selection is unspecified. These limitations weaken confidence in the result most directly used to motivate the proposed benefit on structured sequences.
Questions for authors
-
How does the implemented WO-RNN recurrence differ from BioOSS beyond a change of state coordinates, particularly in its parameterization and placement of nonlinearities? Is there comparative evidence that these differences improve performance?
-
Does the SHD input mapping impose any locality constraint, or is there evidence that meaningful channel-to-grid alignment emerges during training? Please also clarify how the random-topology ablation was constructed and whether coupling scales and the gradient–divergence negative-adjoint relationship were preserved.
-
How were SHD hyperparameters and checkpoints selected, given that no validation split is reported? Are repeated-run results available to assess the reliability of the improvement over the strongest listed LSTM configuration?
-
Could you specify the multiscale PDE architecture and how it incorporates the wave update? If no corresponding control is available, a targeted comparison that retains the surrounding architecture while replacing the wave update would materially help establish the operator’s contribution.
-
Could you reconcile the settings in Appendices C and D, distinguishing initialization values from learned parameters? Under the stated discretization, c = 80, dt = 0.1, and dx = dy = 1 imply a strongly expansive autonomous linear operator. Is additional scaling used, or does training move the coefficients into a different regime? This concerns the interpretation of the implemented dynamics, rather than a claim that the complete nonlinear recurrence is unstable.
6 comments
Thank you for the additional experiments and clarifications. The rebuttal substantially addresses my concerns about SHD reliability and the role of input modulation. However, two central concerns remain: the benefits of explicit spatial coupling and nonlinear feedback relative to BioOSS have not been established through a controlled comparison, and the PDE experiments do not isolate the wave operator’s contribution within the multiscale architecture. These gaps still limit the evidence for the method’s distinctive contribution.
We thank the reviewer for the constructive follow-up. We conducted two additional controlled comparisons to address the remaining concerns regarding the contributions of explicit wave recurrence, nonlinear feedback, and the wave operator within the multiscale PDE architecture.
1. Controlled comparison with BioOSS
We evaluated three recurrent variants on SHD using identical data splits, surrounding architecture, training protocol, and validation-based checkpoint selection across three paired seeds (42–44).
| Recurrent backbone | SHD accuracy (%) |
|---|---|
| BioOSS core | 84.23±0.58 |
| WO-RNN without nonlinear feedback | 88.72±0.67 |
| Full WO-RNN | 91.20±0.71 |
Replacing the BioOSS modal recurrence with the explicit WO-RNN implementation improves accuracy by 4.49±0.76 percentage points across paired seeds. This comparison retains differences in parameterization and scan direction, so the improvement cannot be attributed exclusively to spatial coupling.
More directly, introducing within-transition nonlinear feedback improves accuracy by 2.47±0.61 percentage points under otherwise matched conditions. This isolates the contribution of nonlinear recurrent state evolution and provides evidence for a key architectural distinction from BioOSS.
The three-seed full WO-RNN results are a subset of our previously reported five-seed evaluation, using the same checkpoints and protocol.
2. Isolating the wave operator in PDE forecasting
We conducted a controlled operator-replacement comparison on RD2D, retaining the same multiscale encoder, recurrent-state dimensions, channel mixing, cross-scale fusion, decoder, autoregressive rollout, and training protocol.
We replaced the structured gradient–divergence wave update with a learnable 3×3 local convolutional recurrence while keeping the surrounding architecture unchanged. Both models have nearly identical parameter counts.
| Recurrent operator | RD2D test nRMSE ↓ | Parameters |
|---|---|---|
| WO-RNN wave operator | 0.050549±0.014592 | 18,123,676 |
| Local convolution | 0.063620±0.019459 | 18,123,919 |
Across three paired seeds (42–44), the wave operator achieves 20.5% lower mean test nRMSE, with a mean paired difference of 0.013070±0.021057.
WO-RNN outperforms the convolutional recurrence in two of three seeds. The improvement is seed-dependent, and three seeds are insufficient to establish statistical significance. The convolutional baseline is approximately 4.3% faster at inference.
Nevertheless, this comparison provides direct empirical evidence that the wave-structured recurrent operator can improve forecasting performance independently of the surrounding multiscale architecture.
We will incorporate these results into the revised manuscript, including the controlled configurations, per-seed results, and methodological limitations. We appreciate the reviewer's suggestions, which helped us strengthen the experimental attribution of WO-RNN's contributions.
We thank the reviewer for recognizing WO-RNN's design and scope. We provide five-seed ablations, input-projection analyses, and clarifications.
W1 & Q1: Beyond BioOSS
WO-RNN shares BioOSS's damped two-field wave system but differs in state evolution, beyond coordinate changes.
BioOSS uses approximate diagonal modal recurrence for parallel scans, omitting cross-mode interactions under heterogeneous propagation. WO-RNN retains these via local gradient–divergence updates with spatially varying coefficients.
Within-transition nonlinear feedback yields state-dependent Jacobians beyond BioOSS's linear core, enabling nonlinear evolution at the cost of scan parallelism. Learned input/output mappings support recurrent modeling.
Our contribution is a general recurrent backbone combining heterogeneous local propagation and nonlinear feedback, extending wave-based sequence modeling to broader applications, including spatiotemporal PDE forecasting.
W2 & Q2: Topology, mapping, and coupling
Dense input projection does not enforce tonotopy. Grid topology constrains latent interactions, while input organization is learned.
Across five checkpoints, adjacent-channel cosine similarity rises from −0.0005±0.0013 to 0.6958±0.0225, versus ≈0.063 under permutations. Adjacent centroid distances beat the null (0.70 vs. 1.09). This supports learned channel-order structure, not proven tonotopic or causal alignment.
Five-seed SHD ablations (accuracy %, mean±std):
Removing coupling costs 11.59 points versus 1.18 for modulation. With BN+Dropout, losses are 10.73 and 0.01. Coupling dominates within WO-RNN, without proving topology alignment.
The exploratory random-topology ablation uses a 10%-sparse Gaussian matrix of matched density. Degrees vary (mean≈102.4, SD≈9.6), and negative adjointness is lost. It is not degree/operator matched. We claim no grid optimality or isolated topology effect, only superiority over this random variant.
Q3: SHD selection and reliability
Official SHD has 8,156 train / 2,264 test samples without validation. We use 7,340 train / 816 validation (split seed 42) for tuning, scheduling, early stopping, and checkpointing.
The original 135-configuration sweep used test feedback. We repeated all configurations with validation-only selection and five-seed evaluation (42–46).
The original 90.59% vs. 89.89% comparison was single-seed. Under the revised protocol, unmodulated WO-RNN achieves 89.80±.45%, versus LSTM 86.66±.89% and GRU 86.34±.40%. Modulated results appear in W2. Full results are in the revised PDF and our reply to 6SXY.
Q4: PDE architecture and attribution
The PDE forecaster uses three scales (64/32/16). CNNs lift frames into four latent channels per scale. Wave cells, shared across time, evolve primary and auxiliary states via local gradient–divergence coupling with trainable propagation and damping.
Tanh, 1×1 channel mixing, and cross-scale fusion follow each update. A residual CNN decoder combines multiscale primary states and the previous frame for autoregressive prediction. Auxiliary states contribute through coupling.
CNNs handle representation/reconstruction, while WO-RNN provides structured temporal evolution. Multiscale processing is not novel. Our SSM baselines use multilayer architectures, and published PDE baselines use established designs. The key distinction is the recurrent operator, modeling heterogeneous local propagation.
Q5: CFL, discretization, and stability
Linear stability differs from nonlinear training behavior. For c=80, dt=0.1, dx=dy=1, the directional Courant number is 8, beyond linear CFL bounds, but linear instability need not imply nonlinear divergence.
Tanh can suppress local amplification, while learned heterogeneous damping alters dynamics. Some configurations beyond CFL limits remained trainable, without guaranteeing stability.
Paired forward/backward differences avoid spurious high-frequency null modes of central–central stencils and trained more robustly in preliminary tests. We claim neither unconditional stability nor dissipation from truncation-error cancellation.
Original Appendix settings involved exploratory test feedback. Validation-only search now selects c=80, dt=0.005, dx=dy=1, giving an initial Courant number of 0.4, within conventional bounds.
We will update Appendices C/D to distinguish historical settings, selected initializations, and learned coefficients. Linear stability analysis does not guarantee stability of the trained nonlinear system.