- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CurvFM, a curvature-aware flow matching framework that improves the physical fidelity of generated molecular structures through Hessian-based supervision. The authors argue that geometric accuracy alone does not guarantee physical correctness, as geometrically similar structures can exhibit different energies, forces, and PES curvatures. Unlike energy- or force-based approaches that rely on zeroth- or first-order information, CurvFM incorporates second-order curvature information to better capture the local PES characteristics of conformers and transition states (TSs).
CurvFM fine-tunes pretrained flow matching models without modifying their architectures. During training, the predicted velocity field is used to estimate the clean molecular structure, and a pretrained, frozen Hessian predictor (HIP) computes Hessians for both the estimated and reference structures. An auxiliary loss minimizes their Hessian difference, weighted by a time-dependent schedule. Direct Hessian prediction avoids the expensive higher-order derivatives required by energy-based potentials. The authors also investigate low-eigenmode subspace matching but ultimately adopt full Hessian matching, which performs better in their ablations. The framework introduces no additional inference-time computation.
Experiments cover TS generation using React-OT on three Transition1x datasets and conformer generation using ET-Flow on GEOM-QM9. For TS generation, CurvFM largely preserves geometric accuracy while reducing barrier-energy errors and maximum forces, improving Hessian eigenvalue accuracy, and increasing Hessian-based TS validity rates. For conformer generation, it maintains comparable coverage and RMSD while substantially reducing energy and force deviations before relaxation.
Critical strengths
1. Simple and Efficient Integration of Physics-Based Supervision: The paper addresses an important limitation of geometry-based molecular generation: low structural error does not necessarily imply physical accuracy. Incorporating PES curvature provides a physically motivated direction for improving generated molecular structures. Additionally, the proposed approach is simple and can be incorporated into existing flow matching architectures without modifying the generator or introducing additional inference-time overhead.
2. Improvements in Physical Fidelity Across Two Generation Tasks: The experiments demonstrate improvements in physical metrics across conformer and TS generation. In particular, the improvements in QM-evaluated energy, force, and Hessian properties suggest that the method provides benefits beyond merely matching the predictions of the pretrained Hessian surrogate.
Critical weaknesses
1. Insufficient Experimental Validation
• Insufficient Comparison with Existing Physics-Based Baselines: Comparisons with energy-guided generation (e.g., EnFlow) or Hessian-assisted post-generation refinement should have been provided. Also, CurvFM achieves comparable performance to DiTMC but does not demonstrate clear, consistent improvements in physical metrics (Table 16, 17). The authors' argument that improving a weaker backbone to a comparable level is sufficient is not fully convincing.
• Limited Evaluation of Sampling Efficiency and Scalability: The authors should provide comparisons with existing methods in terms of physically valid structures generated under matched computational budgets. Also, conformer experiments are limited to small GEOM-QM9 molecules, without validation on larger drug-like systems.
• Incomplete Validation of Physical and Chemical Validity: Valid TS (%) only checks for one negative Hessian eigenvalue, without ensuring near-zero forces or correct reactant–product connectivity. Reporting joint force–Hessian validity rates and the Chemical Accuracy Rate used in React-OT would provide stronger evidence of the physical and chemical validity of the generated structures.
• Insufficient Evidence for Model-Agnostic Generalization: Although CurvFM is presented as a model-agnostic framework, the experiments employ only one backbone architecture per task: ET-Flow for conformer generation and React-OT for TS generation, which is insufficient to claim the model-agnostic feature of this framework.
2. Unclear Practical Benefits after Geometry Optimization
• Despite improvements in physical accuracy before relaxation, the performance gap largely disappears after geometry optimization, while gains in optimization efficiency remain modest or inconsistent (Table 4). Therefore, the practical advantages of Hessian-based supervision over the original backbones remain unclear.
Questions for authors
Major Questions
-
While Hessian matching empirically improves physical accuracy, similar Hessians do not necessarily imply proximity to the same stationary point. Could the authors further justify why directly matching reference Hessians is an appropriate objective for molecular structure generation? In particular, could they provide a theoretical explanation or empirical analysis of why minimizing Hessian differences leads to lower force errors, despite not directly constraining the energy gradients?
-
CurvFM incorporates Hessian supervision as an additive term to the original Flow Matching objective. What motivates this simple additive formulation, rather than a more explicitly coupled geometric–physical learning objective such as transfer learning, multi-task learning? How are potential conflicts between geometric accuracy and curvature accuracy addressed?
-
Is there a particular reason for focusing on Flow Matching? Given that Flow Matching learns a velocity field rather than directly predicting molecular structures, could the authors clarify what the flow matching model actually learns from Hessian-matching supervision? In particular, how does matching the Hessians of estimated endpoints and reference structures influence the learned velocity field?
-
The paper frames CurvFM as a molecular structure generation framework, yet much of the evaluation focuses on reproducing reference structures and their physical properties. Could the authors clarify how the proposed task differs from structure prediction, particularly in terms of its generative nature and intended applications?
-
Could the authors release the reproducible source code?
Minor Questions
-
Why is Subspace Hessian Matching (Eq. 5) introduced in the main Method section when it is not used in the final model? Furthermore, the ablation considers only k=8 lowest eigenmodes. Would the conclusion favoring Full Hessian Matching remain consistent across different subspace sizes or eigenmode selection strategies?
-
Table 8 reports negative mode overlap based on the lowest-eigenvalue eigenvectors. Is this metric computed over all generated structures or only those with exactly one negative Hessian eigenvalue? If all structures are included, how should the overlap be interpreted for structures with zero or multiple negative eigenvalues?
4 comments
Q1: Why Hessian matching lowers force errors
We have added a theoretical analysis in Appendix B. The residual compares Hessians at the endpoint estimate x̂₁ and the reference x₁, so it acts locally around the reference stationary point. Expanding both the force and the Hessian around x₁ shows that both depend linearly on the same displacement δ = x̂₁ − x₁. Assuming that every displacement other than a translation changes the Hessian to first order, the Hessian error bounds the displacement, and thereby the force, Fₘₐₓ ≲ κ‖ΔH‖ (Frobenius norm). The force thus vanishes with the Hessian error, although it never enters the objective. Empirically, the Hessian error and the maximum force of the generated TSs are strongly correlated (Spearman ρ = 0.76 on Transition1x-2p3p4p, both computed with GFN2-xTB), and both grow with the RMSD to the reference, as predicted (Appendix B, "Empirical verification").
Q2: Additive formulation and conflicts between objectives
We chose the additive form to keep CurvFM simple and agnostic to both the model and the generative framework. The residual only requires an endpoint estimate, which flow matching, diffusion, and direct structure prediction all provide (see Q3), so it can be added to any such objective without architectural changes, additional heads, or training stages. CurvFM can thus be seen as multi-task learning with a shared model, with physical knowledge transferred from a pretrained PES surrogate. More explicitly coupled objectives are an interesting direction for future work, but lie outside the scope of this paper. Regarding conflicts, our new analysis in Appendix B shows that near the reference, the gradient of the residual has a strictly positive inner product with the endpoint error that the FM loss corrects. The residual thus reweights the same correction toward curvature-sensitive directions rather than introducing a competing target. Empirically, the two gradients align for 97.8% of the one-shot predictions on Transition1x-2p3p4p (Table 7, Appendix B). Conflicts arise mainly far from the reference, at small t, where the weight tᵖ suppresses the residual, so 99.5% of the training weight falls on aligned samples. We thank the reviewer for this question, which led us to add this analysis of the loss gradients.
Q3: Focus on flow matching and effect on the velocity field
We use generative models because both tasks are inherently generative (see Q4). Of the two most prominent frameworks, flow matching and diffusion, we chose flow matching because its straight transport paths yield accurate one-step endpoint estimates during training, on which the residual relies. Both frameworks implicitly contain a structure prediction loss. With the linear path xₜ = (1 − t)x₀ + t x₁, target velocity uₜ = x₁ − x₀, and predicted velocity v(xₜ, t), the endpoint estimate x̂₁ = xₜ + (1 − t) v(xₜ, t) gives δ = x̂₁ − x₁ = (1 − t)(v(xₜ, t) − uₜ), so predicting the velocity is equivalent to predicting the structure, and the FM loss penalizes δ up to a time-dependent factor. The same holds for diffusion, whose noise and data predictions relate linearly to x̂₁, and for direct structure prediction (Appendix B). The residual therefore acts on the same velocity error as the FM loss, but weights its components by how strongly they change the curvature of the PES, so the velocity field learns to correct physically relevant errors most strongly
Q4: Generation versus structure prediction
Both tasks are generative in nature. In conformer generation, a molecular graph admits many 3D conformers following the Boltzmann distribution, and our evaluation accordingly measures how well the generated ensemble recovers the reference ensemble, through recall, precision, and ensemble properties (Section 5.2). TS generation is likewise a distribution task. A reaction can proceed along several transition paths, and different conformers of the reactant and product lead to competing TSs. Current TS datasets, however, cover only one minimum energy path per reaction, so the reference TS is the only ground truth available for evaluation, and the TS ensemble cannot be assessed directly. In practice, such models can still recover TS ensembles when provided with ensembles of reactant and product conformers, which is the intended use in reaction network exploration and kinetic screening.
Q5: Code release
We will release the full source code upon publication, including the training and evaluation pipelines, the finetuned HIP surrogates, the trained model checkpoints, and the data splits, so that all results can be reproduced.
Q6: Role of the subspace variant and choice of k
We introduce the subspace variant in the Method section for two reasons. First, it illustrates that CurvFM is a general framework rather than a single loss, as curvature can be compared entrywise, projected onto selected modes, or combined with other PES quantities such as forces, and we hope these variants inspire further formulations. Second, it tests the natural hypothesis that constraining only the lowest modes, which define the TS character, suffices. Our analysis shows that the gains stem mainly from the stiff curvature outside any low-lying subspace, so the full residual performs best (Section 5.1). We chose k = 8 to cover the two lowest vibrational modes, as the six rigid-body modes are retained for numerical stability (Appendix C.2.5). As k grows, the subspace variant approaches the full residual, which it covers entirely at k = 3N. We have added ablations with k = 1 and k = 15, using the weights optimized for k = 8 (Appendix C.2.5). Neither changes the picture. With k = 1, the energetic metrics fall slightly below the structural baseline, and k = 15 performs on par with k = 8.
Q7: Interpretation of the negative mode overlap
The overlap in the main table is computed over all generated structures. Since the lowest mode of a structure without or with several negative eigenvalues need not correspond to a reaction coordinate, we have added an analysis that resolves the overlap separately for valid TSs and the remaining structures (Appendix C.2.2). Among valid TSs, both models reach virtually the same median overlap (e.g. 98.2 versus 98.5% on Transition1x-2p3p4p), and among the remaining structures they differ by at most 1.5 percentage points. The small overall gain therefore stems not from a more accurate reactive mode, but from the larger fraction of valid TSs under CurvFM.
We thank you for taking the time to review our paper and for your constructive feedback. As the discussion deadline is approaching, we wanted to ask whether there are any remaining concerns or questions that we could address.
W1.1: Comparison with physics-based baselines
We thank the reviewer for this suggestion. We have added a comparison with Hessian-assisted post-generation refinement (Section 5.1 line 445-455, Appendix C.2.6). We use HIP as an MLIP that drives a P-RFO optimization, with the Hessian predicted directly by the surrogate, both to refine the generated TSs and to search from scratch. Refinement yields more accurate structures, but even a single step triples the cost per reaction, full refinement raises it by a factor of about 40, and the optimization occasionally fails where the MLIP is unreliable. CurvFM keeps the inference cost of the baseline and produces no such failures, so the two approaches are complementary, with refinement as an optional final step for the most promising candidates.
Regarding DiTMC, we agree that comparable performance alone does not establish the benefit of curvature supervision. We therefore quantify the contribution of CurvFM through controlled comparisons within each backbone. For ET-Flow, both variants start from the same checkpoint and are finetuned for 50 epochs. Adding CurvFM reduces the median maximum-force deviation from 15.91 to 6.02 kcal/mol/Å (62%) and the median ensemble-energy deviation from 0.49 to 0.15 kcal/mol (69%), while leaving the global structural metrics largely unchanged (Section 5.2). The same holds for React-OT and GoFlow (Appendix C.2.7), at no additional inference cost. The DiTMC comparison serves a different purpose, namely assessing absolute performance. Despite its lower structural accuracy, ET-Flow with CurvFM achieves 19% lower mean maximum-force deviations, while DiTMC remains ahead on the ensemble and minimum energies by about 20%. Higher structural accuracy thus does not necessarily imply higher physical fidelity. We have revised Section 5.2 (line 486-493) and Appendix C.3.2 accordingly, distinguishing the improvements attributable to CurvFM from this cross-model comparison.
W1.2: Sampling efficiency and scalability
CurvFM samples at exactly the cost of its backbone (91 ms per reaction, Appendix C.2.6), so under a matched inference budget it yields more physically valid structures. Regarding larger systems, we have added Pt(II)-catalyzed methane C–H activation (Pt-cat), a catalysis application with systems of up to 45 atoms (mean 26), roughly twice the size of the Transition1x reactions (Appendix A.1). CurvFM nearly halves the median barrier error and triples the chemical accuracy rate from 8 to 24% (Section 5.1, Appendix C.2.1).
Newly added Table 8 (Appendix C.2.1):
W1.3: Physical and chemical validity of the generated TSs
We have added both analyses to Appendix C.2.3. First, we report the joint validity, i.e. the fraction of generated TSs with exactly one negative Hessian eigenvalue and a maximum force below a given threshold, as a function of that threshold. CurvFM yields the higher fraction at every threshold, most clearly on Transition1x-TMC. Second, we report the chemical accuracy rate following React-OT, i.e. the fraction of TSs with a barrier error below 1.58 kcal/mol. CurvFM raises it from 38.9 to 44.9% on Transition1x-2p3p4p and from 13.7 to 22.7% on Transition1x-TMC, and from 8 to 24% on the newly added Pt-cat set (Appendix C.2.1).
W1.4: Model-agnostic generalization
To test architecture independence, we have added experiments with GoFlow, a second TS generation backbone, on RDB7 (Appendix C.2.7). We use the public HIP checkpoint as surrogate, although RDB7 uses a different level of theory (ωB97X-D3/def2-TZVP) than HIP was trained on. CurvFM again improves the energetic metrics, reducing the median barrier error by 8% and the median maximum force by 10%, with reductions of about 25% in both means. Together with React-OT and ET-Flow, CurvFM thus improves three different backbones across two tasks.
W2: Practical benefits after geometry optimization
We agree that the main value of CurvFM lies before relaxation, which matters most in screening applications, where optimizing every candidate is too costly. Our new comparison with MLIP-driven optimization shows that even a single refinement step triples the cost per reaction (see W1.1). We have added two applications where the generated structures are used directly (Section 5.1, Appendix C.2.1). On Pt-cat, CurvFM triples the fraction of TSs within chemical accuracy from 8 to 24%. In a combustion reaction network, ranking the competing channels by the energies of the raw generated TSs improves the Spearman correlation with the reference barriers from 0.75 to 0.89, so the relevant pathways are identified more reliably before any optimization.