- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a general framework for gauge-equivariant normalized aggregation on Riemannian manifolds, covering both convolution and attention. The authors further develop a spherical implementation using exact spherical geometry, Levi-Civita parallel transport, and quadrature weights, enabling attention over scalar, vector, and tensor feature fields. Experiments on shallow-water dynamics and spherical semantic segmentation demonstrate the benefits of geometric hidden representations.
Critical strengths
-
The paper presents a unified framework for gauge-equivariant aggregation with explicit conditions for isometry equivariance. The theoretical formulation is clear and provides a useful perspective on geometric attention.
-
The combination of exact spherical geometry, parallel transport, and quadrature-based aggregation is technically interesting. The resulting implementation achieves exact gauge equivariance and supports different geometric feature types.
-
The experiments demonstrate improvements over scalar-based spherical architectures. The ablation studies provide meaningful evidence for the benefits of vector and spin-2 hidden representations, while the cross-discretization experiments demonstrate some degree of transferability.
Critical weaknesses
-
Gauge-equivariant attention has already been investigated in GET (He et al., 2021) and EMAN (Basu et al., 2022), while quadrature-based spherical attention was introduced by Bonev et al. (2025). Although the proposed integration is valuable, the individual components are largely established. The paper could more clearly distinguish its fundamental methodological contributions from existing approaches.
-
The isometry-equivariance theorem appears closely related to established principles in gauge-equivariant neural networks. It is unclear whether the theorem provides a substantially new theoretical insight or primarily extends existing results to normalized aggregation.
-
Although the ablations demonstrate the benefits of geometric hidden representations and attention, the contributions of exact parallel transport, quadrature weighting, and steerable value kernels are not individually evaluated. More targeted ablations would help establish which design choices are essential to the observed improvements.
-
The proposed models incur substantial computational overhead compared with existing spherical architectures. This raises concerns about their scalability and practical advantages, particularly when the performance improvements are relatively modest.
Questions for authors
-
What is the precise theoretical contribution of Theorem 1 beyond existing results on gauge-equivariant convolution and attention?
-
Could the authors clarify the key methodological differences from GET, EMAN, and the spherical attention framework of Bonev et al. (2025), particularly which capabilities cannot be achieved by straightforward extensions of these methods?
-
Could additional ablations isolate the effects of exact parallel transport, quadrature weighting, and steerable value kernels?
-
How do the authors justify the additional computational cost relative to the achieved performance gains? Could a comparison under matched computational budgets be provided?
Addressing each question in order:
See the general comment and our response to Reviewer gZvA.
Relative to Bonev et al. (2025), our attention layer processes geometric features, particularly scalars, tangent vectors, and spin-2 fields. Our experiments provide evidence that these directional features bring value to learning scalar signals on the sphere. GET and EMAN already provide gauge-equivariant attention. Compared with GET and EMAN, our spherical realization adds quadrature weights, exact spherical geometry, and neighborhoods defined by fixed geodesic radii. Because of these additions, our learned operator can be evaluated on different spherical discretizations without retraining, as demonstrated in Table 1, although performance degrades relative to evaluation on the training grid. We do not prove that these capabilities cannot be obtained by an extension of GET or EMAN. Our contribution is the general framework addressed in question 1, a spherical realization of that framework, and experiments that study the effect of hidden field type and aggregation components on predictive performance.
Thanks to your recommendation, we added ablations of quadrature weighting in attention layers and the steerable value kernel (Table 2). The quadrature ablation keeps the true Legendre-Gauss weights in the encoder, decoder, and loss. We did not add a parallel transport ablation. Parallel transport can not be meaningfully removed all together since the features leave in distinct spaces. It is also not clear to us which approximation is most informative in an exact vs approximate parallel transport experiment. For instance one could approximate surface normals, the connection, the geodesic, or the transport map. We do not, however, doubt that such experiments could be useful.
Again, thanks to your recommendation, we added a matched-training-time experiment to our shallow-water comparisons (Figure 2).