- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LEAP (Learned Energy on Action Paths), a framework for learning differentiable action functionals directly from complete trajectories. By estimating a path-level density-ratio correction relative to a tractable reference process, LEAP enables trajectory optimization, sampling, and constraint-based inference without retraining. Theoretical analyses establish action recovery under suitable assumptions and characterize nonadditive trajectory dependencies. Experiments on stochastic transitions, orbital dynamics, and molecular simulations demonstrate accurate action recovery and reuse across different inference objectives.
Critical strengths
-
The paper introduces a useful perspective by learning reusable objectives over complete trajectories rather than focusing on local dynamics or trajectory generation. This formulation naturally supports multiple downstream inference tasks.
-
The theoretical analysis provides a principled foundation for action recovery and nonadditive trajectory dependencies. Experiments across several physical systems demonstrate the effectiveness and versatility of the proposed framework.
Critical weaknesses
-
The core learning objective relies on contrastive density-ratio estimation, a well-established technique. Although applying this approach to complete trajectories is interesting, the paper does not sufficiently clarify its methodological advantages over existing energy-based or density-ratio learning approaches with comparable path-level representations.
-
LEAP requires sufficient overlap between the reference and target trajectory distributions, which may be difficult to achieve in complex or rare-event systems. Furthermore, the molecular experiments operate on reduced two-dimensional coordinates, leaving the scalability and effectiveness of the framework on more complex molecular configurations insufficiently
The paper presents an interesting and well-motivated framework for learning reusable trajectory-level objectives, supported by theoretical analysis and promising experimental results. However, the methodological novelty beyond existing density-ratio estimation remains insufficiently established, and the dependence on reference distributions raises concerns about generalizability.
Questions for authors
What are the fundamental methodological differences between LEAP and conventional density-ratio estimation applied to complete trajectories?
How does LEAP perform when the reference distribution has poor overlap with the observed trajectories, particularly for rare-event transitions?
Can the authors provide evidence that LEAP remains effective for higher-dimensional molecular representations beyond the two-dimensional collective coordinates?
5 comments
Thank you for the detailed rebuttal and additional experiments. Your responses have addressed many of my concerns and strengthened the paper. I have brief follow-up questions.
- Were the baseline models compared under similar model capacities and training settings?
- How can a suitable reference process be selected when the underlying dynamics are unknown?
- Does the performance remain stable as the molecular representation becomes more complex and higher-dimensional?
We thank the reviewer for their follow up questions and are glad that the additions have helped address their concerns and strengthen the paper.
Were the baseline models compared under similar model capacities and training settings?
Yes, we use the same training data, similar model capacities and training budgets for each comparison. We clarify the following in greater detail:
- Path EBMs (additional comparison): We additionally trained the same 3 path energy architectures using contrastive divergence with Langevin sampling and a replay buffer. We kept the networks, 5000 selected trajectories, training updates and checkpoint selection fixed. At the same cost per update, LEAP's contrastive training achieves correction NRMSE of 0.10, 0.17 and 0.68 for structured, sum pooled and Transformer energies vs 0.15, 0.27 and 1.0 for conventional EBM training. This shows that LEAP's contrastive training improves recovery even with the same path energy architectures.
- Conditional dynamics (App. C.1): Conditional MLE uses the same potential network, optimiser and number of updates as LEAP, or the same cubic drift family. With 128 trajectories, LEAP decreases drift MSE from 0.34 to 0.12. While both achieve similar accuracy with 5000 trajectories, LEAP does not evaluate the event probability.
- Molecular models (App. F): LEAP, binary NRE and velocity regression share the same correction family, with each tuned over 4 learning rates and 2 widths (39k-205k parameters). Conditional DDPM and flow matching have approximately 200k parameters, with approximately 4 times as many optimizer updates as LEAP.
- History models (App. E.3): GRU and neural CDE mixture density models use the same accumulated orbital features, and we tune them over 3 widths and 3 learning rates (50k-1.1M parameters). Increasing training from 100 to 300 epochs does not result in improved recovery. LEAP-Global achieves higher path ordering accuracy on each run as well.
We therefore show that LEAP improves action recovery compared to conventional EBM training, achieves better drift recovery with limited selected data and gives more accurate trajectory ordering than history-conditioned dynamics models. The learned action can also be reused across inference tasks without retraining.
How can a suitable reference process be selected when the underlying dynamics are unknown?
We can construct references with information available from the observed trajectories. For example, on the double well, we use a Brownian reference with diffusion estimated from the observed quadratic variation; in this setting, LEAP recovers the drift as accurately as conditional MLE and also recovers the potential barrier (App. C.1). For alanine, we fit the reference drift to the training increments by least squares and estimate the diagonal diffusion from the residuals. We also condition this reference using bridge proposals, with acceptance rates of 9-22% across the torsion and internal coordinate representations.
We also evaluate the reference fit before training by measuring the likelihood of observed trajectories under the reference. The reference fits the data better in 48 internal coordinates (reference likelihood gap of 1.6 nats per transition) than in aligned Cartesian coordinates (30-38 nats per transition), which helps guide the choice of representation. We also find that increasing the number of reference samples improves recovery when there is limited overlap. Using a fitted linear reference in 64 dimensions, increasing K from 8 to 128 decreases drift MSE from 0.024 to 0.0046 (see App. D).
Does performance remain stable as molecular representations become more complex and higher dimensional?
Yes, across the representations tested. At 600 K, the held-out AUROC is 0.985, 0.980 and 0.975 for 2, 4 and 8 torsions, and 0.993 for 48 internal coordinates (App. F.2). LEAP decreases sparse completion error by approximately 10-12% compared to the reference action across all representations. With 4 and 8 torsions, LEAP gets a completion error of 0.110 vs 0.134-0.164 for conditional DDPM and flow matching.
These results show that action learning is effective in higher-dimensional molecular representations (i.e., as the representations become more complex), and the same learned action also supports different inference objectives without having to retrain.
We thank the reviewer once again for their constructive questions, and we will update the PDF to reflect these additional results. We would be happy to answer any further questions. We hope our responses and revisions resolve your concerns; if so, we would greatly appreciate it if you would consider updating your assessment of our paper.
Thank you,
Authors
We thank the reviewer for their thoughtful feedback and for recognizing the value of learning reusable objectives over complete trajectories, and the theoretical motivation and experimental diversity. We have clarified the method contributions and extended the experiments on reference overlap, rare events and higher dimensional molecular representations in the updated pdf.
W1/Q1. What distinguishes LEAP from conventional density-ratio estimation on complete trajectories?
LEAP builds on density ratio estimation to learn the stochastic action as a reusable objective for trajectory inference. Our reference-based construction has two important properties: (i) conditioning the reference on the event selecting the data preserves relative action differences (Proposition A.3), and (ii) under shared diffusion, the structured correction identifies the physical drift difference (Eq. 9), allowing the learned action to be reused under new boundary conditions. Proposition 3.1 further connects the contrastive gradient to conditional maximum likelihood without evaluating the event probability. For persistent latent regimes, Proposition A.5 characterizes the nonadditive interactions captured by global corrections.
We clarified these contributions in Sections 1.1 and 3 and added comparisons with generic path energies on the double well, using the same selected trajectories, reference and objective. With 5,000 training trajectories, we have the following results (Section C.4, Tables 13-14).
We also evaluate on unseen terminal events without retraining, conditioning the reference on each event while keeping the learned correction fixed. This shows that the structured correction improves action recovery over generic path energies and supports reuse under new terminal conditions.
W2/Q2. How does reference overlap affect LEAP, particularly for rare events?
We agree that reference overlap is important for accurate density ratio estimation. We extended our experiments to study terminal event conditioning, reference overlap and computational cost (Sections C.1 and D).
We evaluate increasingly rare terminal events, with probabilities down to 9e-6. LEAP achieves drift accuracy comparable to conditional maximum likelihood across these events, while directly conditioned Brownian and linear Gaussian references avoid rejection sampling. At the rarest event, conditional MLE with rejection sampled trajectories requires 7,909 times as many simulated path steps (Section C.1). We also study overlap across trajectory lengths and dimensions. At 64 dimensions, a Brownian reference gives path KL 30 nats and drift MSE 0.056. Using a reference with half the true drift decreases these to 7.4 nats and 1.3e-4. With a fitted linear reference that does not require the true drift, increasing K from 8 to 128 decreases drift MSE from 0.024 to 0.0046 (Section D). These results quantify the effect of poor overlap and show how reference choice and additional samples improve action recovery. Constructing efficient conditioned references for more complex nonlinear systems is an interesting direction for future work.
W2/Q3. Does LEAP extend beyond two-dimensional molecular coordinates?
We extended the molecular experiments by training separate actions using 2, 4 and 8 torsions and 48 internal coordinates (Section F.2).
LEAP achieves high held out trajectory discrimination accuracy across all representations and consistently reduces sparse completion error compared with the reference action. With 4 and 8 torsions, LEAP has completion error 0.110, vs 0.134-0.164 for conditional DDPM and flow matching. Action learning and downstream inference therefore extend beyond the original two backbone angles.
We thank the reviewer again for the helpful suggestions and hope these additions address the concerns. We would be happy to answer/clarify any remaining questions during the discussion period.
Thank you,
Authors