- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper revisits the SE(3)-Transformer through the lens of Hamiltonian dynamics. It defines a parametrized Hamiltonian flow on the phase space of positions and velocities, corresponding to minimizing an energy functional that couples an optimal-transport-based potential with a damped momentum term; applying a Lie–Trotter splitting to this flow yields the HamFormer layer, whose feedforward computation is claimed to implement one optimization step of that functional. HamFormer is then combined with EGNN to form a model for molecular ground-state conformation optimization (refinement from an RDKit-initialized conformer), with position, relation, momentum, and scalar-feature states evolving jointly in latent space. Empirically the paper evaluates on QM9 and Molecule3D (random split) using D-MAE, D-RMSE, and C-RMSD against 2D graph models (GINE, GATv2, GPS, GTMGC) and 3D refinement baselines (SE(3)-Transformer, EGNN, ConfOpt variants, WGFormer), and adds a layerwise analysis of latent kinetic/potential energy and architectural ablations on the momentum state.
Critical strengths
-
The dynamical derivation is a principled way to design an equivariant layer, and it buys real parameter efficiency. Rather than adding another attention variant, the paper derives the layer's computation from a Lie–Trotter splitting of a specified Hamiltonian flow, so each architectural component corresponds to a term in the energy functional (as summarized in Table 1). The payoff is measurable: HamFormer reaches lower errors than WGFormer on QM9 with 16.3M parameters against 78.9M — a ~79% reduction — which supports the claim that second-order phase-space dynamics is a more parameter-efficient inductive bias than the first-order Wasserstein gradient flow used by the closest prior method.
-
The layerwise energy analysis is an attempt at interpretability that goes beyond accuracy reporting. Figure 3 tracks latent kinetic energy, potential energy, and total Hamiltonian across six layers, showing an overall dissipative trend with a transient kinetic surge at the stage boundary (layer H4), and the ablation that zeroes the learned momentum at inference gives a sizeable degradation (test C-RMSD 0.654 → 0.714 Å on Molecule3D). Together these are at least a coherent story linking the architecture to the dynamics it was derived from, and the momentum ablation is a genuine, falsifiable test of the design choice.
Critical weaknesses
-
The empirical gains are small and reported without any measure of uncertainty, which is exactly the regime where the claimed advantage is hardest to defend. On QM9 the headline comparison is test C-RMSD 0.198 vs. 0.206 Å for WGFormer (about a 4% relative improvement), with D-MAE and D-RMSE differences of similar magnitude; on Molecule3D the reported improvements are likewise in the third decimal place. No standard deviations, confidence intervals, number of seeds, or paired significance tests are given, and the baseline numbers are taken from Wang et al. (2025) rather than re-run. Since HamFormer and WGFormer share the same evaluation protocol and differ by a modest architectural change, seed-level variance could plausibly account for the gap. A reviewer cannot distinguish a real improvement from run-to-run noise here.
-
The baseline set is narrow relative to the current conformation-prediction literature, and the task is restricted to refinement. All 3D baselines belong to the WGFormer/ConfOpt lineage, plus EGNN and SE(3)-Transformer; there is no comparison with recently published equivariant generative or refinement models for conformers that would establish where HamFormer sits in 2026. The setting is also refinement-only — the model starts from an RDKit conformer and improves it — so the results do not speak to de novo conformer generation, yet the abstract's claim of "consistently outperforming state-of-the-art competitors" is stated without that qualification. Finally, the physical interpretation is currently descriptive: a monotone decrease of a latent scalar labelled "potential energy" and a transient rise labelled "kinetic energy" do not by themselves demonstrate that the network implements a Hamiltonian flow, since the quantities are learned latent projections with no calibration against actual molecular energy.
Questions for authors
-
Please report mean ± std over at least three seeds for HamFormer and WGFormer on both datasets, together with a paired significance test on per-molecule C-RMSD. If the 0.198 vs. 0.206 gap is within seed variance, how should the claim of consistent outperformance be restated?
-
Can you add at least one strong recent 3D conformer model outside the WGFormer lineage as a baseline under the same protocol? If not, please state explicitly that the comparison is restricted to that family.
-
Is the latent "potential energy" in Figure 3 calibrated in any way against true molecular energy (e.g. correlation with DFT energy on the test set)? Without such calibration, what evidence supports reading the layerwise curve as physical dissipation rather than as an unconstrained learned scalar?
-
The method is evaluated as a refinement step from an RDKit conformer. How much of the final accuracy is attributable to the initial conformer, and how does the model behave for molecules with large initial RMSD (e.g. the worst decile)? Does the advantage over WGFormer grow or shrink there?
-
The momentum ablation (ρ = 0) degrades accuracy noticeably. Is the learned momentum interpretable in physical units, or is it better described as a learned memory term? A clarification would help calibrate the strength of the "Hamiltonian" claim.