- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors introduce EPOCH, a method for integrating higher-order geometric information into equivariant neural networks. The authors evaluate the effectiveness of EPOCH across a range of molecular property prediction tasks. Empirically, EPOCH improves the expressiveness of different equivariant neural network backbones for such tasks, while allowing less expressive models to achieve results competitive to those of more expressive models via EPOCH's directional sampling mechanism.
Critical strengths
- The authors identify a key bottleneck in atomistic representation learning (i.e., efficiently obtaining expressive geometric embeddings) and propose EPOCH to address this bottleneck.
- EPOCH works well across a range of equivariant neural network backbones.
- EPOCH injects important information for molecular property prediction (and likely other tasks) in a way that reduces the computing requirements needed to achieve high levels of prediction accuracy with a lower computing budget.
Critical weaknesses
- The authors do not discuss [1], from what I can tell, which limits the proposed impact of this work, given that new equivariant methods (e.g., EquiformerV2 [2]) have already begun to incorporate eSCN's efficient SO(2) convolutions for higher-order geometric representation learning [1].
- The authors do not discuss the inference-time implications of EPOCH, that is, how much using EPOCH slows down a given equivariant method during high-throughput inference of new molecules' properties. It would be good to include this kind of result in this paper.
- The authors do not discuss whether or how EPOCH may (negatively) impact the equivariance errors that equivariant methods currently achieve. For instance, does EPOCH introduce additional optimization difficulties or expressiveness constraints beyond improved property prediction accuracy?
- In Table 1 of the manuscript, I'd like to see how EPOCH + method
Xcompares to methodXalone, whereXis a state-of-the-art method for QM9's molecular properties, such asX=EquiformerV2(as this would test whether EPOCH's additional higher-order directional sampling improves over EquiformerV2's efficient eSCN higher-order convolutions [1, 2]).
References:
[1] Passaro, S., & Zitnick, C. L. (2023, July). Reducing SO(3) convolutions to SO(2) for efficient equivariant GNNs. In International Conference on Machine Learning (pp. 27420-27438). PMLR.
[2] Liao, Y. L., Wood, B., Das, A., & Smidt, T. (2024, May). EquiformerV2: Improved equivariant transformer for scaling to higher-degree representations. In International Conference on Learning Representations (Vol. 2024, pp. 39282-39309).
Questions for authors
- Would the authors please correct the typo
descriptor-side side channelthat I found on lines 143-144? - Would the authors please rewrite certain phrases in the main text, such as
should therefore be read(Line 277) andan MD22 host–guest experiment(Line 468), as these sound very much like awkward LLM-generated phrases? - Less of a question and more of a note: the authors' anonymous GitHub link (provided in the PDF) doesn't work when I tested it.