- Rating
- 4(+2)
- Confidence
- 4
- Informativeness
- 3(+1)
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This paper introduces Hessian-Informed Flow Matching (HI-FM), which incorporates the anisotropy of physical energy landscapes into flow matching. Standard linear conditional probability paths constract equally in all directions. Hi-FM instead uses energy Hessians precomputed at training samples to construct paths with direction-dependent contraction rates. This preserves the source distribution and target endpoints while allowing faster contraction along stiff, high-curvature direction. Hessians are used to construct the training paths and regression targets but are not required during generation. Experiments on Hessian-QM9 and GEOM-Drugs, using SemlaFlow as the primary backbone, show improvements in energy, strain, and bond-length distribution metrics over the baseline under matched optimizer-update budgets, while maintaining broadly comparable chemical validity. Improved alignment between the Jacobians of the learned vector fields and the energy Hessians further indicates that the model better captures local energy curvature.
Critical strengths
- The paper addresses the lack of explicit physical anisotropy in standard linear flow matching paths.
- The main idea is straightforward, and the paper clearly explains what the proposed change is meant to achieve.
Critical weaknesses
- The empirical evidence is limited in scope. The curvature analysis does not cover generated molecules, and the effect of Hessian quality and its cost are not isolated. All comparisons disable OT coupling within a single backbone family, and the GEOM-Drugs results rely on Hessians computed away from MMFF94 minima and on a single training seed. As a result, it is not yet clear how robust the gains are and whether they generalize beyond the specific settings tested.
Questions for authors
My concerns are mainly about the scope of the empirical evidence rather than the core idea. I would be open to raising my score if the authors can address these questions during the rebuttal, even with preliminary results (e.g., a small-scale run or a single additional seed).
- Does the improved Hessian-Jacobian alignment also hold for generated molecules? How do their Hessian spectra compare with those of the data?
- Could the authors compare DFT Hessians, MMFF94 Hessians on the same Hessian-QM9 molecules and report preprocessing and total training costs?
- Do the gains persist with OT coupling enabled in SemlaFlow? Whould HI-FM also improve other models, such as FlowMol?
- How close are the GEOM-Drugs structures to MMFF94 minima, as measured by their gradients? Are the gains consistent across additional training seed?
3 comments
Part 2/2
Response to Question 3:
We tested whether HI-FM's gains remain when SemlaFlow's native equivariant OT coupling is enabled. Both methods were trained on 10% Hessian-QM9 with matched training settings:
| Metric | SemlaFlow + OT | HI-FM-D + OT |
|---|---|---|
| Energy/atom | 2.293 | 2.103 |
| Strain/atom | 1.056 | 0.954 |
| Length ( Å) | 1.807 | 1.460 |
| Angle () | 1.352 | 1.069 |
| Validity (%) | 93.66 | 93.78 |
Compared with SemlaFlow using the same OT coupling, HI-FM-D reduces energy by 8.3%, strain by about 10%, bond-length by 19%, and bond-angle by 21%, with similar validity. The strain gain is smaller than the 22.6% with independent coupling, but HI-FM still improves the OT-coupled baseline. Its benefit is therefore not restricted to independent coupling.
Additional architectures: In the paper, we also tested an EDM-style EGNN backbone with three seeds, four data fractions, and all three HI-FM variants, using the same default (Section C.1, Table 6). Across these comparisons, seed-averaged median energy decreases by 4.9-12.7% and strain by 10.1-18.2%, with higher mean validity. These results show that the gains also hold on a second backbone with the same default parameters.
All EGNN runs use independent coupling. In those experiments, “OT-FM” refers to the straight-line conditional-OT path, not explicit source-target OT coupling. Since HI-FM modifies the coordinate path, it could in principle also be adapted to models such as FlowMol while retaining their categorical training objectives. We have not tested FlowMol, so our evidence beyond SemlaFlow comes from the EGNN results.
Response to Question 4:
GEOM-Drugs conformations were optimized with GFN2-xTB, so nonzero MMFF94 gradients are expected. Their mean MMFF94 energy and strain are about 1.1 and 0.36 kcal/mol/atom (Appendix B.6). The low strain indicates that they are close to MMFF94 minima in energy, but does not imply that their MMFF94 gradients are zero. Following the reviewer's suggestion, we computed MMFF94 gradients on 2,000 GEOM-Drugs conformations. The median RMS atomic gradient magnitude, including hydrogens, is 16.53 kcal/mol/Å, compared with 18.25 for DFT-optimized Hessian-QM9.
HI-FM does not require the data to be MMFF94 minima. Its positive contraction rates keep the conditional path endpoint at the observed conformation, even when . A full linearization of the MMFF94 force would also include the constant term . We instead use the local Hessian to modify the flow-matching paths towards the observed conformation, not to reproduce MMFF94 relaxation.
As requested, we also repeated the 10% GEOM-Drugs experiment with a new training seed to check whether the gains hold. Both methods used matched training and evaluation settings:
| Metric | Original experiment (SemlaFlow) | Original experiment (HI-FM-D) | New training seed (SemlaFlow) | New training seed (HI-FM-D) |
|---|---|---|---|---|
| Energy/atom | 2.060 | 1.783 | 2.014 | 1.694 |
| Strain/atom | 1.318 | 1.081 | 1.288 | 1.010 |
| GFN2-xTB strain/atom | 0.939 | 0.692 | 0.868 | 0.661 |
| Validity (%) | 90.47 | 91.49 | 92.29 | 92.14 |
| Mol. stability (%) | 95.71 | 94.99 | 96.76 | 96.36 |
| Length | 0.813 | 0.603 | 0.747 | 0.597 |
| Angle | 1.640 | 1.638 | 1.427 | 1.494 |
The energy, strain and bond-length gains hold with the new seed: HI-FM-D reduces these metrics by about 16%, 22% and 20%, respectively. Mean GFN2-xTB strain is also about 24% lower, so the strain improvement holds under a different evaluation potential. Bond-angle is nearly unchanged in the original experiment but slightly worse with the new seed. Validity and molecular stability are also comparable in the new run.
Thank you for addressing my questions. I view the paper’s main idea positively, and my only concern was the limited experimental evidence. The additional results provide some reassurance regarding robustness across random seeds and the fairness of the experimental settings. On this basis, I support acceptance.
Part 1/2
We thank the reviewer for the careful assessment and for stating which results would strengthen the paper. We address each point below.
Response to the Critical Weakness and Question 1:
To test whether Hessian-Jacobian alignment extends to generated molecules, we evaluated the 10% Hessian-QM9 models on a shared set of 1,000 generated molecules: 500 from each method. Both learned fields were evaluated at the final coordinates of every molecule in this set. We computed the diagnostic MMFF94 Hessians at these coordinates without relaxing the geometries.
HI-FM-D achieves substantially higher alignment on this shared set of generated geometries. Since both fields are evaluated at identical molecular coordinates, this advantage is not due to evaluating each method on a different set of generated structures.
We also checked whether the generated structures themselves have curvature statistics closer to the reference conformations. For this, we compared their normalized internal Hessian spectra, negative curvature and gradients:
Spectra are normalized by each molecule's largest absolute internal eigenvalue. Negative curvature reports the percentage of conformations with an internal eigenvalue below −10−2 on this scale. Gradient RMS is over atomic gradient magnitudes, including hydrogens, in kcal/mol/Å.
Compared with SemlaFlow, HI-FM-D reduces spectral distance by 57%, median gradient RMS by 22%, and the fraction with substantial negative curvature from 37.0% to 22.9%. Thus, the higher alignment is accompanied by generated structures with normalized curvature statistics closer to the reference. The Hessian evaluations are used for the diagnostics above; sampling itself requires no Hessian evaluations.
Response to Question 2:
Following the reviewer's suggestion, we compared HI-FM-D using DFT and MMFF94 Hessians at the same 3,100 conformations from 10% Hessian-QM9. We also tested whether the gains persist when using only the ten stiffest DFT modes or adding 25% internal noise to the DFT Hessians.
MMFF94 gives similar energy, strain and geometry gains to DFT in this comparison. Using only ten modes still retains 76% of the energy gain and 80% of the strain gain obtained with full DFT Hessians over SemlaFlow. With 25% internal noise, at least 94% of the full-DFT gain remains in each of the four energy and geometry metrics. These results show that the gains do not require a complete, unperturbed DFT Hessian.
The gains are also not limited to MMFF94 evaluation. On GEOM-Drugs, HI-FM-D trained with MMFF94 Hessians reduces mean GFN2-xTB strain by about 26% with 10% training data and 23% with full data, relative to SemlaFlow.
For preprocessing, we reuse the public DFT Hessians for the 13,607-molecule Hessian-QM9 pack without repeating quantum-chemical calculations. Their eigendecomposition takes about 7 s on one CPU core. Constructing MMFF94 Hessians at the same coordinates takes about 0.6 min, followed by eigendecomposition. The cached eigensystems occupy 0.16 GiB.
For training, we measured complete 33,000-update runs on 10% Hessian-QM9 using one H200 GPU, including periodic validation. SemlaFlow took 7.63 h, while HI-FM-D took 7.86 h with either Hessian source, a 3.0% increase. With equivariant OT, SemlaFlow took 7.82 h and HI-FM-D took 8.11 h, a 3.7% increase.
In separate A100 benchmarks with three paired seeds, the per-update overhead falls from 16.8±4.1 on 10% Hessian-QM9 to 2.6±1.0 on the full dataset. Thus, the per-update overhead is substantially smaller on full QM9 in these benchmarks.
We will add these results and protocols to the revised manuscript.