- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces SPLICE, a MACE-derived interatomic potential that replaces the radial MLP used to generate tensor-product weights with a compact learnable spline parameterization. It also decouples the edge-message width from the node-trunk width. The implementation uses Loom to fuse radial evaluation, spherical harmonics, tensor products, and aggregation, avoiding materialization of a large per-edge radial tensor. Experiments demonstrate favorable speed–accuracy trade-offs on molecular datasets and include several physically motivated evaluations. The efficiency gains are promising. However, the contribution would be more compelling if it were positioned and evaluated as an architectural modification and implementation strategy for existing equivariant MLIPs, with SPLICE serving as one plugin. My main concerns are the attribution and generality of the method, the technical novelty of the hardware-aware implementation, and the limited workload coverage of the bottleneck analysis.
Critical strengths
- The paper addresses an important practical limitation of machine-learned interatomic potentials. The cost of energy-and-force evaluation for large molecular systems. Reducing edgewise work while preserving useful predictive accuracy is practical.
- The architecture and configuration details in Appendix B make the mathematical changes relatively easy to identify. The separation of edge and node widths is also a useful design choice to investigate.
Critical weaknesses
The paper overstates its novelty by presenting an architectural modification as a fundamentally new model. The main contribution should be an efficient replacement/plugin/tool for the radial MLP in existing equivariant architectures, rather than a new model.
The authors replace the function that maps radial information to the scalar weights of an equivariant tensor product. Schematically, the original computation is edge_weights = radial_MLP(radial_features), whereas SPLICE uses weights of learnable spline functions. Choosing a spline instead of an MLP for this scalar mapping is not a new mechanism. I wonder whether the same replacement principle could potentially apply to other models with distance-conditioned scalar filters, including non-equivariant architectures.
I would like to see controlled experiments that apply the modification to other MLIPs, such as NequIP. The authors can report the performance of 1) the baseline MLIP models, 2) Radial MLP with separate kernels, 3) Spline with separate kernels, 4) Spline with optimized fusion. This comparison would separate radial parameterization from fusion and test whether the benefit transfers beyond MACE.
Questions for authors
See weaknesses.
3 comments
Thank you for the work on modification to NequIP. It responds to the specific question well.
Thank you, we are glad the NequIP experiment answers your question.
Following your suggestion, we will change the positioning in the main paper. The abstract and introduction will present the contribution as a method (profile the model, find the dominant operation, replace it) whose result for equivariant MLIPs is a fused spline that replaces the radial MLP. SPLICE will be presented as its instance for MACE-family layers, and the NequIP results will go into the main text to show that the change transfers.
We hope our reply also covers your other points: the ablation that separates the spline from fusion, and the bottleneck profile on five workloads. Our reply to Reviewer 69Pb also compares the size of our speed-up with accepted papers that replace one dominant operation, which bears on the novelty question. If anything is still unclear, we would be glad to clarify before the discussion closes.
We would like to thank the reviewer for their comments and for the constructive suggestions. We ran the experiment they proposed. We report the results below and will add them to the manuscript.
1. The change applied to NequIP. We implemented NequIP in our code with InstaDeep's NequIP-SPICE2 configuration (5 layers, l_max 2, 5 Å cutoff). We trained it on SPICE2 with a radial MLP or with our spline, using the same recipe:
Overall, the model is 4.3–6.9× faster (2.7k–24k atoms) and can fit at least 28× more atoms per GPU. The benefits thus transfer to other architectures, although we have to note that for very different models an appropriate architectural change might touch very different operations, depending on the profile. To decouple the widths, we doubled every multiplicity of the node features (e.g. 128x0e instead of 64x0e) and kept the tensor product and its spline weights at the published multiplicities, with linear layers projecting between the two. The per-edge work is unchanged; the added parameters (3.0M in total, vs 1.3M for the MLP arm) act per node. With decoupled widths, the force error is 16% below the MLP's at 6.8× the speed.
2. Separating the parameterization from fusion. We used one code version, GPU and system (MACE-style model, 48k-atom water, H100), with the same tensor-product kernel in every arm.
The parameterization alone gives 1.5×, moving it into the kernel is the largest step: 3.1× in total, of which 1.2× comes from the spherical harmonics and 2.6× from fusing the spline. It has to be noted that changing the architecture is what enables the fusion in the first place: a closed-form spline is cheap enough to recompute inside the kernel, so the per-edge weight tensor is never stored. A radial MLP would have to run a small dense network per edge inside the kernel, or store its per-edge output as the baseline does. The same MACE weights run about 2× slower in mace-torch with cuEquivariance than in our code (FP32, measured on two MACE models). This is not included in the 5.7× above.
3. Positioning. We agree that our main contribution in this work is a method:
The fused spline and the decoupled widths are what this gives for MACE-family layers. SPLICE is one instance, and NequIP shows that the change transfers. The same replacement applies in principle to non-equivariant models with distance-conditioned filters: SchNet-style continuous filters are also radial MLPs. We have not tested it, but FlashSchNet (ICML'26) already shows that fusing the filter computation pays off there. The kernel generator is not a main contribution of this paper, and every comparison above holds it fixed.
4. Bottleneck analysis. We profiled the four paper models and the MLP/spline pairs on five workloads, energy plus forces on different systems: water boxes of 2.6k, 10k and 48k atoms; a 35k-atom solvated protein; 1k gas-phase molecules.
What dominates the end-to-end evaluation depends on the model:
We will add this profile to the appendix, and can share per-workload breakdowns if useful.