- Rating
- 3
- Confidence
- 1(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
To address the limitation that traditional SFNOs cannot strictly satisfy rotational equivariance, this paper proposes LCG-SFNO. It combines low-rank Clebsch-Gordan (CG) cross-order coupling with quadratic nonlinear operations based on exact spectral projection, achieving end-to-end SO(3) equivariance. To reduce computational overhead, the authors further introduce SSHCG, which accelerates CG operations through sparse computation and low-rank factorization. In experiments involving spherical shallow-water equations and the WeatherBench benchmark, this method reduces equivariance error to the level of numerical precision, while maintaining or improving predictive performance compared to standard SFNOs.
Critical strengths
-
The paper provides a structurally complete and well-validated solution for end-to-end rotational equivariance. To achieve end-to-end SO(3) rotational equivariance, the paper uses low-rank CG coupling to implement strictly equivariant cross-degree nonlinear interactions. It further applies quadratic nonlinear activation on an oversampled grid and removes aliasing errors through exact spectral projection, preventing discrete nonlinear operations from breaking equivariance.
-
The efficient CG implementation provides clear engineering value. By optimizing CG computation through sparse traversal, output tiling, and fused reduction, the proposed method reduces unnecessary computation and intermediate tensor overhead. Combined with low-rank channel compression and restricted spectral bandwidth design, the CG coupling can be efficiently applied to large-scale spherical forecasting.
Critical weaknesses
-
The improvement in forecasting performance cannot be fully attributed to CG in the final model. Table 2 shows that strengthening the backbone alone improves one-day ACC from 84.0 to 93.4, while adding CG further improves it to 93.7. However, the final precisely dealiased model achieves 93.3 ACC / 82.1 MSE, which does not show clear advantages compared with the enhanced no-CG backbone with a different nonlinear configuration (93.4 / 81.5). In addition, the SFNO baseline uses spectral bandwidth , while LCG-SFNO uses , and the codec designs are also different. Adding a fully matched final no-CG ablation would significantly strengthen the attribution of the contribution.
-
Treating all atmospheric variables as scalar spherical fields limits the scope of the claimed physical equivariance. The paper represents all input variables as independent spherical harmonic coefficient channels and adopts a unified SO(3) scalar representation framework. This representation is reasonable for scalar variables such as temperature; however, variables such as zonal and meridional wind are intrinsically tangent vector fields on the sphere rather than scalar fields. Under true three-dimensional rotations, the local basis of tangent vector fields also changes with position, and therefore the two horizontal wind components typically mix during rotation. If wind components are treated as independent scalar channels, the model may guarantee SO(3) equivariance under the scalar-channel representation, but this does not necessarily correspond to the physical rotational transformation law of real atmospheric vector fields. The authors should clarify the current representation scheme and the scope of their equivariance claim.
Questions for authors
-
Regarding the independent contribution of CG coupling to the final forecasting performance, could the authors provide a no-CG ablation experiment with exactly the same configuration as the final LCG-SFNO model? The current Table 2 B→C ablation demonstrates that CG coupling improves WeatherBench performance under the GELU activation and data-grid nonlinear setting (ACC improves from 93.4 to 93.7, and MSE decreases from 81.5 to 77.9). However, the final model further introduces quadratic activation, exact spectral projection, and different oversampling configurations. Since these designs change the nonlinear pathway and numerical properties of the network, it remains unclear whether the independent forecasting contribution of CG still exists in the final strictly equivariant model. A matched experiment with only CG removed under the final configuration would further validate the contribution of CG to the final model performance.
-
The paper represents all input variables as independent spherical harmonic coefficient channels. Could the authors clarify the rotational representation of vector-valued atmospheric variables (e.g., horizontal wind fields)? Specifically, are zonal and meridional wind components treated as independent scalar spherical fields, or are they represented using vector field representations that follow the SO(3) transformation law? This point is important for understanding the scope of the paper's claimed "rotational equivariance", because equivariance under a scalar-channel representation is not necessarily equivalent to the physical rotational transformation law of atmospheric vector fields.
-
Regarding the algorithmic novelty of SSHCG, could the authors further clarify its differences from existing efficient CG computation methods (e.g., Gaunt tensor products and related tensor factorization methods)? While the paper provides comparisons with e3nn and cuEquivariance and relates the factorized route to existing Gaunt-based formulations, the precise algorithmic novelty of SSHCG remains somewhat unclear. Could the authors distinguish the genuinely novel components of the sparse direct kernel from implementation-level optimizations and clarify the additional contribution of the factorized route relative to prior work?
5 comments
W2 / Q2. Representation of Wind Fields and Scope of Equivariance
LCG-SFNO represents each input channel as a scalar field whose spherical-harmonic coefficients transform through Wigner D-matrices. Accordingly, the joint equivariance relation in Eq. (3) and the measurements in Table 1 refer to simultaneous rotations of the scalar channels and spatial conditioning fields.
This representation directly corresponds to physical rotations for scalar quantities, including temperature, height, vorticity, and divergence. In the WeatherBench experiments, zonal and meridional winds are treated as separate scalar channels, following the benchmark configuration. Under rotations about Earth's polar axis, this representation is compatible with the physical transformation of horizontal wind components. Under general SO(3) rotations, however, the local tangent basis also transforms, causing the wind components to mix. Thus, the reported WeatherBench equivariance is defined under the specified scalar-channel representation.
The architecture also supports physical vector-field equivariance through a Helmholtz–Hodge representation. A tangent velocity field can be represented by scalar vorticity and divergence using vector spherical harmonics. These scalar fields are processed by the same LCG-SFNO spectral blocks and subsequently reconstructed into the velocity field. Since the transformations between vector fields and their scalar potentials commute with rotations, this formulation preserves the physical SO(3) transformation law without modifying the learned CG coupling or exactly projected nonlinear pathway.
This representation is used in our SSWE experiments, where height, vorticity, and divergence constitute the dynamical state. The corresponding wind-field interface is also implemented, while WeatherBench retains the component-wise representation for consistency with the evaluated baselines.
The distinction between these representations clarifies the scope of the results. The SSWE experiments establish equivariance under the physical rotational representation, while the WeatherBench experiments demonstrate numerical equivariance under the specified scalar-channel action. This distinction will be made explicit alongside Eq. (3) and in the appendix.
Q3. Algorithmic Contributions of SSHCG Relative to Existing Efficient CG Methods
SSHCG is designed for broad-band Clebsch–Gordan coupling in spherical spectral operators, where interactions span all degrees up to , outputs extend to , and both parity sectors are included. This setting differs from the predominantly low-angular-degree workloads of equivariant interatomic models addressed by implementations such as OpenEquivariance [1] and FlashTP [2]. Existing work also exploits CG sparsity and efficient Gaunt products [3, 4]. SSHCG focuses on efficient full-spectrum coupling while preserving learnable degree-path interactions.
The implementation provides two complementary computational routes.
Sparse direct route. This route evaluates the original CG contraction with independent learnable weights for each admissible degree path. Its main algorithmic features are the reuse of channel-independent angular sparsity patterns and direct accumulation of multiple degree-path contributions into output tiles. These operations avoid materializing large intermediate tensors while retaining the unrestricted degree-path parameterization.
Factorized route. This route applies a CP factorization to the learnable degree-path weights. It combines efficient Gaunt products for even-parity interactions with spherical Poisson brackets for odd-parity interactions, supporting both parity sectors within a unified learnable spectral operator. The factorized route reproduces the direct contraction for weights represented by its factorization, while the sparse direct route retains independent degree-path weights.
These two routes provide complementary tradeoffs between parameterization flexibility and computational efficiency. The sparse direct route preserves the original learnable CG contraction, while the factorized route improves scalability for wider coupling bandwidths.
Table C. Forward-and-backward evaluation time of a single CG block (Table 3).
| Coupling bandwidth | Dense | Sparse direct | Factorized |
|---|---|---|---|
| 12/24 | 16.6 ms | 4.6 ms | 4.1 ms |
| 31/31 | 855 ms | 35.6 ms | 5.3 ms |
At 31/31 bandwidth, the sparse direct and factorized implementations achieve approximately 24-fold and 161-fold speedups over the dense reference, respectively. The factorized route also exhibits weak runtime growth across the tested bandwidths, increasing from 3.2 ms at 4/8 to 5.3 ms at 31/31.
The default LCG-SFNO configuration uses the sparse direct implementation at 12/24 bandwidth to retain independent learned degree-path interactions. The factorized route provides an efficient alternative for wider coupling bands.
The principal contribution of SSHCG is therefore the combination of full-spectrum CG coupling, learnable degree-path interactions, and computationally efficient sparse or factorized evaluation. The sparse direct route reduces intermediate-memory and contraction costs without restricting the learned degree-path weights, while the factorized route extends efficient spectral products to both parity sectors. Together, they make learned CG interactions practical at forecasting-relevant spectral resolutions.
References
[1] Bharadwaj et al. (2025). An Efficient Sparse Kernel Generator for O(3)-Equivariant Deep Networks. ACDA.
[2] Lee et al. (2025). FlashTP: Fused, Sparsity-Aware Tensor Product for Machine Learning Interatomic Potentials. ICML.
[3] Xie et al. (2025). The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products. ICML.
[4] Luo et al. (2024). Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Products. ICLR.
Thank you PC4n for the detailed review and constructive suggestions. We address the independent contribution of CG under the final architecture, clarify the rotational representation of atmospheric vector fields, and distinguish the algorithmic contributions of SSHCG from existing efficient tensor-product implementations.
W1 / Q1. Independent Contribution of CG Under the Final Architecture
To isolate the contribution of CG coupling under the final strictly equivariant architecture, we conducted additional matched experiments comparing LCG-SFNO with a no-CG control and a parameter-matched quadratic-branch control. All three models share the same spectral backbone, codec, exactly projected nonlinear pathway, oversampling, and training protocol. The no-CG control removes only the CG branch, while the quadratic-branch control replaces learned CG with an exactly projected quadratic interaction at comparable parameter capacity.
Table A. WeatherBench one-day test performance over three training seeds.
All three models maintain equivariance errors near numerical precision. LCG-SFNO achieves the lowest forecasting MSE, improving upon both the no-CG control and the parameter-matched quadratic control. This establishes that learned CG coupling provides additional predictive benefits beyond the strengthened backbone, exact quadratic interactions, and increased parameter capacity. The improvement is consistent with the original GELU-based ablation (Table 2, B→C), where adding CG reduces MSE from 81.5 to 77.9.
We also compare the wall-clock time required to reach common validation wRMSE thresholds under the final architecture.
Table B. Training-step cost and wall-clock convergence (seed 42).
Despite approximately 11% greater per-step cost than the no-CG control, LCG-SFNO reaches the same validation target approximately 37% faster in wall-clock time. Its computational cost is also nearly identical to the parameter-matched quadratic control, while achieving faster convergence and better forecasting accuracy.
Regarding the original SFNO comparison, the backbone improvements and CG contribution are evaluated separately. In Table 2, row A represents the reference SFNO with spectral bandwidth L=15, while row B uses a strengthened backbone with L=31, an improved codec, and regularization. The improvement from A to B therefore reflects these backbone changes rather than CG coupling. The original B→C comparison isolates the contribution of CG under GELU activation, while the new matched experiments establish its independent contribution under the final exactly projected quadratic architecture.
Together, these results distinguish the contributions of the stronger spectral backbone, learned CG interactions, and equivariance-preserving nonlinear pathway. CG consistently improves forecasting accuracy within matched configurations and provides substantial wall-clock convergence benefits under the final architecture.