- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents LEVI, a diffusion-based learned energy model calibrated using force labels from clean structures. Through this calibration, LEVI learns not only the energy landscape but also the correct magnitude, allowing it to be additively combined with other force fields at inference time in a molecular dynamics engine. The method is evaluated on a tilted double-well potential and the alanine dipeptide system, demonstrating its ability to be incorporated into MD simulations in unseen environments.
Critical strengths
None
Critical weaknesses
-
LEVI involves a relatively complex training procedure, yet its ultimate goal appears to be replacing the computation of classical force fields during MD simulations. I find the significance of this direction somewhat unclear. On the one hand, classical force fields are generally more computationally efficient than deep learning-based force fields, while the paper does not provide any comparison of the computational efficiency between MD simulations using LEVI and those using conventional force fields. On the other hand, both experiments in the main text are trained and evaluated on a single system, without demonstrating whether LEVI has the ability to generalize across different systems. Therefore, the practical utility of the proposed method should be questioned.
-
LEVI obtains a conservative force field by taking the gradient of a predicted scalar quantity. Compared with machine learning force fields (MLFFs) that directly predict an unconstrained vector field, LEVI involves a more complicated training procedure, yet the experiments do not clearly demonstrate its advantages over existing MLFFs. For example, the Introduction mentions that MLFFs may lead to simulation instability. In this case, it would be more convincing to include an MLFF baseline and run MD simulations on the same systems for comparison. Otherwise, given that MLFFs are already quite mature and have achieved near ab initio level accuracy on small systems, the novelty and necessity of the proposed method are not sufficiently clear.
Questions for authors
- As mentioned in the Weakness section, after undergoing a relatively complex training procedure, LEVI appears to merely replace part of the role of classical force fields during MD simulations. Since the main text does not provide a specific explanation of this point, I do not see a clear necessity for introducing LEVI in this setting. Could the authors provide additional experiments comparing LEVI-MD with conventional force-field MD in terms of computational efficiency, cross-system generalization, and related aspects, so as to better demonstrate the advantages of LEVI?
- I believe that the "zero-shot environment transfer" claim made in the title and throughout the main text is somewhat overstated. Due to the additive decomposition of the potential energy shown in Eq. (1), when LEVI is used to replace , the term that actually describes the interaction between the target system and the environment (e.g., water molecules), , does not involve the model at all. Therefore, changing the environment does not directly expose the model to out-of-distribution data. Could the authors provide further theoretical or experimental justification for referring to this setting as zero-shot environment transfer?
- LEVI adopts a conservative force-field formulation, which appears to be the main source of its increased training complexity. However, the experiments do not demonstrate clear advantages of LEVI over MLFF approaches that directly fit the force field using an unconstrained vector field. In particular, MLFFs do not necessarily lead to simulation instability. For example, AI2BMD [1] fits protein force fields with near-ab initio accuracy and is able to run MD simulations on the scale of hundreds of nanoseconds. It would therefore be preferable for the authors to include an appropriate MLFF baseline and perform MD simulations on the same systems for comparison, in order to justify the use of a conservative force-field formulation.
- As shown in Fig. 2(a), LEVI-MD appears to overestimate the populations of and , resulting in a generated distribution that is inconsistent with the true Boltzmann distribution. I believe this observation challenges the claim that LEVI can perform test-time transfer. The authors should provide further clarification on this issue.
- Experiments on a small system such as alanine dipeptide may not be sufficient to fully demonstrate the effectiveness of the model. Could the authors include additional experiments involving training and MD simulations on a larger and more representative system, such as Chignolin?
2 comments
Response to Reviewer idK7 (continued)
A1: LEVI is not intended to replace a classical force field for simulating a known molecule, and it is not faster (Sections 1 and 5). Measured on our cluster, classical explicit-water MD of alanine dipeptide runs at about 870 ns/day on one GPU, against ~4.5 ns/day for LEVI-MD (Common Response 4).
LEVI's purpose is generative: assembling a molecule from scattered atoms inside an environment it never saw in training, which classical MD cannot do. To illustrate this, please see the video LEVIMD_B2AR.mp4 in the supplementary material (Common Response 1). Cross-system generalization is addressed in Common Response 4.
A2: The reviewer is right that U^int does not involve the model. However, the environment changes which conformations the model must describe, and those conformations can be outside its training data. The learned U^sol must therefore be somewhat accurate in conformations it rarely or never saw. In this sense the environment is never seen in training, and the model is evaluated out of distribution. We have made this precise in the revision (Section 1) and use "zero-shot" only in that sense.
A3: We agree that AI2BMD shows MLFFs can run long, stable protein MD. AI2BMD in fact uses both of the design choices the reviewer questions:
- It is conservative. In its Methods, "ViSNet was trained as an energy-conserving potential model; that is, the predicted atomic forces were derived from the negative gradients of the potential energy". This is the same formulation as LEVI.
- It composes a learned solute potential with a classical environment. The protein is described by the ML potential and the explicit solvent by the polarizable AMOEBA force field. This is the additive composition LEVI-MD uses.
AI2BMD solves a different problem from LEVI. It simulates a given protein from given starting structures (folded, unfolded and intermediate conformations from replica-exchange MD). It cannot generate a structure. LEVI's solute term is generative: it builds the molecule inside the environment from randomly initialized atoms, and it is trained from equilibrium structures and their energies. We have added AI2BMD and ML/MM to the Related Work (Section 2, Machine-learned force fields and ML/MM). Please see also Common Response 1.
A4: We agree the overpopulation is real, and we have traced its cause: it is set while the molecule assembles from random positions in water, not by the learned energy. Please see Common Response 2. We have stated this limitation of the assembly protocol in the revision (Sections 4.3 and 5, Appendix D).
A5: We could not complete a Chignolin model in the rebuttal period. Our intended scale-up is a small molecule in a large environment, such as a ligand in a binding pocket (the β2-adrenergic receptor demonstration in Common Response 1), rather than a larger solute. We have listed larger solutes as a limitation and future work (Section 5; Common Response 4).
Response to Reviewer idK7
We thank the reviewer for the review. In response, we clarified the purpose of LEVI and its relation to classical force fields and MLFFs
(including AI2BMD), added a cost comparison with classical MD, clarified the zero-shot claim, and traced the cause of the αL / C7ax overpopulation. Our point-by-point responses are listed below.
W1: LEVI involves a relatively complex training procedure, yet its ultimate goal appears to be replacing the computation of classical force fields during MD simulations. I find the significance of this direction somewhat unclear. On the one hand, classical force fields are generally more computationally efficient than deep learning-based force fields, while the paper does not provide any comparison of the computational efficiency between MD simulations using LEVI and those using conventional force fields. On the other hand, both experiments in the main text are trained and evaluated on a single system, without demonstrating whether LEVI has the ability to generalize across different systems. Therefore, the practical utility of the proposed method should be questioned.
A1: LEVI is not meant to replace classical force fields for simulating a known molecule (see Common Response 1). Its goal is to generate a molecule inside an environment it never saw in training, with the environment responding, which neither classical nor ML force fields can do. We give the cost comparison in Q1 below and in Common Response 4: classical MD is far cheaper for a known molecule, and we state this openly (Section 5). Generalization across systems is addressed in Q5 and in Common Response 4.
W2: LEVI obtains a conservative force field by taking the gradient of a predicted scalar quantity. Compared with machine learning force fields (MLFFs) that directly predict an unconstrained vector field, LEVI involves a more complicated training procedure, yet the experiments do not clearly demonstrate its advantages over existing MLFFs. For example, the Introduction mentions that MLFFs may lead to simulation instability. In this case, it would be more convincing to include an MLFF baseline and run MD simulations on the same systems for comparison. Otherwise, given that MLFFs are already quite mature and have achieved near ab initio level accuracy on small systems, the novelty and necessity of the proposed method are not sufficiently clear.
A2: We clarify two points. For simulation instability, we believe there is a misunderstanding on this point, and we would like to clarify it for the reviewer.
We agree with the reviewer that well-trained MLFFs run stable MD. We have revised the sentence so that this distinction cannot be misread: it now reads "The outputs of these generative models, however, cannot be substituted into F = −∇U" (Section 1).
LEVI is conservative because composition requires it. The solute term must be an energy so that it can be added to U^env + U^int, and so that the energy-regression term can fix its physical scale. The training cost of the conservative form is the same as for any MLFF trained on forces (a gradient of the network output inside the loss). The extra cost specific to LEVI is one forward pass at the clean structure for the energy term (Sec. 5).
The novelty is not higher accuracy than an MLFF on a known molecule. It is a learned energy that can (i) build the molecule from randomly initialized atoms and (ii) be added in physical units to an environment it never saw. For the MLFF baseline, please see Common Response 1.
(continued..)