- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how features evolve through deep simplicial neural networks using the Hodge decomposition. It shows that features can eventually concentrate in one of three types of subspaces: harmonic, gradient, or curl, and provides simple spectral conditions that predict which regime will occur. Experiments on synthetic edge classification and ocean drifter prediction support these theoretical predictions.
Critical strengths
S1. A key strength is that the proposed spectral criterion is both interpretable and practical: after training, it can be computed directly from the learned weights and the relevant Hodge eigenvalues to identify whether the network amplifies harmonic, gradient, or curl components. The theoretical predictions are also supported by some experiments.
S2. The presentation of the paper is clear and well organised, and the figures are generally well designed and help illustrate the main ideas and results.
Critical weaknesses
W1. The novelty is meaningful but somewhat narrow. The harmonic/gradient/curl spectral-concentration framework is a clean extension of existing graph and simplicial oversmoothing analyses, but much of the underlying machinery builds on established Hodge spectral tools. The main conceptual novelty lies in the paired feature-normalised lower and upper Hodge Rayleigh quotients, the resulting three-regime characterisation, and the spectral growth-rate analysis describing when each regime arises. The related-work discussion could be broadened to better position these contributions within existing Hodge-based learning on simplicial complexes. In particular, prior work has already explored Hodge-aware spectral representations and learning architectures, with some works also studying feature propagation and oversmoothing-related behaviour in this setting [1 to 4]. Discussing these works would help clarify more precisely what is new in the proposed harmonic/gradient/curl spectral-concentration framework.
[1] Hodgelets: Localized Spectral Representations of Flows on Simplicial Complexes by Roddenberry and al. (2022)
[2] Topological Signal Processing over Weighted Simplicial Complexes by Battiloro and al. (2023)
[3] Hodge-Aware Contrastive Learning by Möllers and al. (2024)
[4] Graph and Simplicial Complex Prediction Gaussian Process via Hodgelet Representations by Alain and al. (2025)
[5] Binarized Simplicial Convolutional Neural Networks by Yan and al. (2025)
W2. The theoretical analysis is elegant but its strongest predictive results apply to a restricted class of linear, symmetric, depth-shared SNNs, while the conclusions concern asymptotic depth and may therefore not directly characterise the finite depths used in practice. Moreover, the main synthetic experiment defines its labels directly from harmonic, high-frequency gradient, and high-frequency curl eigenspaces, closely aligning the task with the decomposition underlying the theory and making this validation somewhat controlled. The empirical evidence beyond this setting is limited to a single small ocean-drifter dataset. It therefore remains unclear how informative the proposed spectral trichotomy will be for more realistic finite-depth SNNs with nonlinear propagation.
Questions for authors
I would be willing to raise my score if the questions below are addressed and the points raised in the weaknesses section are also adequately answered. Similarly, if they are not addressed, I would consider lowering my score.
Q1. Can the authors provide any finite-depth guarantee relating the predicted asymptotic regime to the Rayleigh quotients observed at the depths used in practice?
Q2. Could the authors include a synthetic task whose labels are not constructed directly from harmonic, gradient, or curl eigenspaces?
Q3. Can the proposed post-training diagnostic be validated on a broader set of real-world datasets or architectures?
3 comments
W2(c) / Q3, Other datasets and architectures We agree that validating the post-training spectral diagnostic and theoretical results across a broader set of datasets and architectures is important and now include additional experiments in Appendix J. We extend the evaluation to two additional real-world datasets, Forex and Last.fm (listener 1), and to nonlinear propagation and published simplicial architectures (Appendix J.2). On both additional datasets, the linear adjacency flow’s Rayleigh quotients approach the endpoints predicted from its trained weights (Figure 7). We also evaluate variants of our flows (Figures 5 and 7), alongside SCoNe, SCNN and SCCNN architectures (Roddenberry et al., 2021; Yang et al., 2022a; Yang & Isufi, 2023), reporting task performance and layerwise Rayleigh quotients (Table 2 and Figure 7). Some qualitative concentration patterns persist under , although the trajectories can retain mixed spectral content and depart from the linear endpoints. These experiments further validate the linear predictor and demonstrate the utility of the paired Rayleigh quotients to characterize finite-depth spectral evolution in more general SNNs, despite not guaranteeing an endpoint. See also Table A in response to reviewer GQFc for additional results on the ocean drifter dataset.
Table B: Forex and Last.fm
| Dataset | Model | Test | Predicted regime (splits) | Dominant regime at depth 1,024 | RQ/ν (down, up) at depth 1,024 |
|---|---|---|---|---|---|
| Forex | Adjacency flow, linear | 0.92 | G 8, C 2 | G 8, C 2 | (0.80, 0.20) |
| Adjacency flow, tanh | 0.89 | G 10 | G 7, C 3 | (0.62, 0.38) | |
| SCoNe, tanh | 0.91 | G 5, C 5 | — | — | |
| SCNN (order 2), tanh | 0.92 | G 6, C 4 | — | — | |
| Last.fm (listener 1) | Adjacency flow, linear | 0.30 | H 10 | H 10 | (0.00, 0.00) |
| Adjacency flow, tanh | 0.30 | H 10 | H 10 | (0.07, 0.07) | |
| SCoNe, tanh | 0.14 | C 10 | — | — | |
| SCNN (order 2), tanh | 0.03 | C 9, G 1 | — | — |
W1, Additional related works and positioning
Finally, we agree that the established Hodge spectral machinery and prior Hodge-aware learning methods should be acknowledged more explicitly. We are grateful for these suggestions and expand our related works section accordingly, as it leads to a stronger final manuscript. We position our contribution as a theory of Hodge spectral concentration that complements existing Hodge-aware architectures and methods as a model-agnostic framework and diagnostic. Under certain conditions, the paired feature-normalised Rayleigh quotients give us the precise results with explicit growth-rate conditions taken directly from trained weights.
Closing We thank the reviewer again for the feedback and the clear pointers for addressing them. We hope that we have addressed all of the reviewer’s concerns with new theory and experiments and would be grateful if they would consider raising their score. We are available throughout the discussion period to clarify any concerns that remain after these responses.
Dear Reviewer rBTs,
With the discussion period closing on November 18 (AoE), we wanted to follow up on the finite-depth bound (W2(a) / Q1), the synthetic edge segmentation task with region-based labels (W2(b) / Q2), and the additional Forex and Last.fm experiments for linear and nonlinear models (W2(c) / Q3). Following discussion with Reviewer YHy1, we have also extended the finite-depth bound (Section 3.2, Proposition 3.7) to elementwise nonlinearities such as under certain conditions, and noted that it holds at every simplicial rank (Remark 3.8). If you've had a chance to review the new results, we would appreciate knowing whether you have any remaining concerns or questions, and we are happy to discuss further.
We thank the reviewer for their thoughtful suggestions. In particular, we appreciate the reviewer's recognition of the theoretical novelty and the interpretability of the Hodge Rayleigh Quotients as a spectral criterion. Below, we address the reviewer's concerns and questions related to the positioning of the contribution, finite depth behavior, and the breadth of empirical evidence.
W2(a) / Q1, Finite-depth guarantees We agree that characterizing finite-depth behavior is a useful extension of the asymptotic theory. We now address this by extending the spectral argument underlying Proposition 3.5 to give an explicit finite-depth bound on the "error" between a Rayleigh quotient at some layer and its limit. We now include this result in Section 3.2 (Eq. (15), the linear case of Proposition 3.7), with its proof in Appendix H.
Under the assumptions of Theorem 3.6, suppose the Euler step size satisfies 2+τ(μ∗+μmin)>0 and the input has nonzero projection onto the leading generator eigenspace. Here μ∗ and μmin are the largest and smallest generator eigenvalues. For either Hodge Rayleigh quotient q, its deviation from the endpoint q∞ predicted by Theorem 3.6 satisfies
\leq \nu_{\max}\frac{C\kappa^{2m}}{1+C\kappa^{2m}}, \qquad m\geq1,$$ where $$C = \frac{\Vert (I-P_{\ast})F_0 \Vert_F^2} {\Vert P_{\ast}F_0 \Vert_F^2}, \qquad \kappa = \max_{\mu_i < \mu_{\ast}} \frac{|1+\tau\mu_i|} {|1+\tau\mu_{\ast}|} < 1.$$ Here $P_*$ projects onto the leading generator eigenspace, $\mu_i$ range over the generator eigenvalues, and $\nu_{\max}$ is $\nu_g^{\max}$ or $\nu_c^{\max}$ for the lower or upper quotient, respectively. The bound identifies two factors controlling finite-depth concentration: (1) the initial mass outside the leading eigenspace relative to the mass inside it ($C$), and (2) the strongest relative amplification per layer outside that eigenspace ($\kappa$). A larger initial leading component and a smaller $\kappa$ give a tighter guarantee. For a fixed trained model and input, this provides an explicit error bound at any specified depth and a sufficient depth to reach a prescribed tolerance around the predicted endpoint. **W2(b) / Q2, Additional synthetic experiment** Regarding a synthetic task with labels not directly derived from H, G, and C eigenspaces, we include an additional experiment in Figure 3 and Table 1 of the manuscript with labels that correspond to the geometric "region" of each edge, i.e. which disk it belongs to, effectively a segmentation task. The learned endpoint rates predict harmonic dominance, and both Rayleigh quotients approach zero under extended propagation, in agreement with this prediction. This provides additional validation of the post-training diagnostic on a task whose labels are not defined by the spectral decomposition underlying our theory. We can tentatively interpret this result as highlighting the importance of harmonic information (i.e. global topological holes) for this particular complex and labeling. | Task | Macro-F1 | Predicted regime | $\mathrm{RQ}_{\mathrm{down}}$ | $\mathrm{RQ}_{\mathrm{up}}$ | |:--|:-:|:-:|:-:|:-:| | Harmonic | 0.952 | Harmonic | $2.5\times10^{-7}$ | $9.6\times10^{-8}$ | | Upper-gradient | 0.919 | Gradient | $0.7412$ | $\approx 0$ | | Upper-curl | 0.902 | Curl | $\approx 0$ | $0.9833$ | | Region | 0.883 | Harmonic | $6.6\times10^{-5}$ | $1.1\times10^{-3}$ | We continue our response in the following comment.