acceptodds
Under review as a conference paper at ICLR 2027

SEAL-BG: Scaling Boltzmann Generation with Equivariant Perception and Local-Coordinate Densities

Abstract

Estimating protein thermodynamics, including conformational populations and free-energy differences, requires sampling molecular equilibrium ensembles, but correlated trajectories and slow conformational transitions make this costly. Boltzmann generators (BGs) offer independent molecular proposals with evaluable densities, enabling energy-based statistical correction. Autoregressive Boltzmann Generators (ArBG) demonstrate this approach using causal Transformers over Cartesian coordinate tokens, with single-system benchmarks extending to Chignolin (10 amino acids). Scaling ArBG to larger proteins motivates presentations that exploit molecular symmetries while distinguishing local geometry from global conformational variation. We introduce SEAL-BG , an atom-autoregressive BG that decouples geometric perception from probabilistic generation. A causal -equivariant geometric encoder encodes the Cartesian coordinates of previously generated atoms, while normalized local-coordinate conditionals model bond lengths, bond angles, and periodic torsions. This separation combines equivariant Cartesian conditioning with structured local-coordinate densities, while analytic local Jacobians preserve an evaluable Cartesian proposal density. We evaluate on four released peptide benchmarks and scale to Trp-cage (20 amino acids, 284 atoms) and Homeodomain (54 amino acids, 947 atoms) using separate within-system ensembles. SEAL-BG achieves competitive energy and torsion distances on the peptide benchmarks and improves raw total-energy overlap relative to ArBG from 0.8651 to 0.8926 on Trp-cage and from 0.4176 to 0.7704 on Homeodomain. Across the evaluated training budgets, SEAL-BG uses geometric-mean factors of fewer training floating-point operations (FLOPs) and fewer A100 GPU-hours than ArBG. These results support separating Cartesian perception from local-coordinate generation as a route toward scalable Boltzmann proposals.

Primary area:
applications to physical sciences (physics, chemistry, biology, etc.)
Keywords:
autoregressive density estimation, tractable likelihood, Boltzmann sampling, importance sampling, protein ensembles

Reviews

Among:
Shape:
1234this paper, Top 30%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.67 over 3 reviews, above 70% of the others.
Reviewer_Gur6OpenReview ↗
Rating
3
Confidence
2
Informativeness
3
Presentation
2
Soundness
2
Read review
Paper summary

The authors use an approach that separates geometric perception from probabilistic generation named SEAL-BG to address the computation and scaling bottleneck of ArBG. SEAL-BG based on an SE(3)-equivariant causal Transformer encodes the Cartesian coordinates of previously generated atoms, while normalized local-coordinate conditionals model bond lengths, bond angles, and periodic torsions. The authors demonstrate that SEAL-BG achieves lower energy distance and competitive torsion metrics on smaller peptide benchmarks, and improves energy agreement on the larger Trp-cage and Homeodomain systems, compared with ArBG, with much less training compute.

Critical strengths

Critical strengths include:

  1. the novel design of separating perception from generation: SEAL-BG uses Cartesian coordinates for global geometric information but generates atoms in chemically meaningful local coordinates. Global Cartesian geometry informs the model about the entire portion generated so far, while local coordinates tell the model how to place the next atom in a chemically sensible way. So SEAL-BG holds advantages of long-range conformation and realistic local molecular structure.

  2. large training efficiency gains shown across tested systems. SEAL-BG shows 15.2× fewer training floating-point operations (FLOPs) and 18.1× fewer A100 GPU-hours than ArBG, while keeping competitive or even improved energy agreement.

[Strengths] Other strengths are as follows:

  1. the authors show that SEAL-BG can work on larger proteins, in addition to testing their model on small alanine peptides. The authors tested it on Homeodomain, which contains 947 atoms. This is much larger than the small peptides commonly used to test similar models.

  2. SEAL-BG treats globally rotated versions of the same protein conformation the same, rather than different conformations.

  3. Good presentation flow. The paper shows normalization and geometric covariance, detailed experimental settings, model hyperparameters, and simulation protocols to enable reproducibility.

Critical weaknesses

A critical weakness is that the paper’s corrected performance depends on clipped importance sampling without reporting standard weight-quality diagnostics, such as effective sample size before and after clipping, the fraction of total weight removed, or sensitivity to the clipping threshold. Also, how clipping shifts bias-variance tradeoff is not reported. It is therefore unclear whether the strong corrected metrics reflect broad overlap with the Boltzmann target or a small number of dominant samples.

[Weaknesses] Other weaknesses are: Limited ablation study: the authors only performed the full SEAL-BG and SEAL0BG without log-dispersion regularization on AL3, 4, and 6 and Chignolin using raw and clipped SNIS energy and torsion Wasserstein distances. Unclear statistical uncertainty: the authors did not report variation results across trained models or confidence intervals. So we do not know if small differences from ArBG are statistically reliable. No limitations addressed in the discussion/ conclusion. Although several limitations or caveats are mentioned throughout the paper, there is no dedicated section discussing these limitations and appropriately narrowing its claims.

Questions for authors

[Questions]

  1. Can you perform controlled, one-component-at-a-time ablations to better identify the source of SEAL-BG’s gains, such as equivariance ablation by replace the SE(3)-equivariant encoder with a standard causal Transformer and coordinate generation ablation by replacing local-coordinate density head with a Cartesian-coordinate head?
  2. Importance-weight reliability. What are the effective sample sizes, maximum normalized weights, and fractions of total weight removed before and after clipping for each system? Do the main conclusions hold without clipping or under different clipping thresholds? How does removing the top 0.2% of weights affect the bias and variance of the reported corrected metrics across independent proposal batches?
  3. Statistical reliabilty: report uncertainty metrics to show how reliable the differences are.
3 comments

We thank the reviewer for the positive assessment and constructive feedback. We address the concerns below.

W1 + Q2. Clipped importance sampling and weight reliability

We thank the reviewer for isolating this issue. We primarily follow the default 0.2% clipping setting in ArBG to maintain consistency with their evaluation protocol. Also, in ArBG, ESS is treated as a metric with the caution that ESS is not a standalone measure of Boltzmann sampling quality, since ESS can favor mode-seeking proposals and, in high dimensions, may be dominated by a few overlap samples or numerical outliers. Likewise, log-weight variance, maximum normalized weight, and removed weight mass are useful metrics of weight concentration, but they can also be dominated by a few overlap samples or numerical outliers. Despite this, we added a weight-reliability panel covering full SNIS and both clipping settings. The results are below.

SystemMethodClippingESS ↑Log-weight variance ↓Max weight ↓Removed mass ↓E-W2 ↓T-W2 ↓
Trp-cageArBG0%1.0000006.726835×10446.726835\times10^{44}1.0000000%154.6844303.803001
Trp-cageSEAL-BG0%1.0040546.762883×10316.762883\times10^{31}0.9979780%23.6980522.142261
Trp-cageArBG0.1%6.5469266.733569×10446.733569\times10^{44}0.28004599.999999999999%21.4358631.939085
Trp-cageSEAL-BG0.1%9.3826746.769653×10316.769653\times10^{31}0.18667999.999141%16.5549931.828551
Trp-cageArBG0.2%10.1919526.740316×10446.740316\times10^{44}0.20235399.999999999999%14.4391071.744697
Trp-cageSEAL-BG0.2%17.6473946.776436×10316.776436\times10^{31}0.10052999.999857%7.6908121.732304
HomeodomainArBG0%1.0000091.518536×10591.518536\times10^{59}0.9999950%327.3937723.755004
HomeodomainSEAL-BG0%1.0000353.729522×10373.729522\times10^{37}0.9999820%51.1802813.775349
HomeodomainArBG0.1%2.5135241.520055×10591.520055\times10^{59}0.56342899.999999%326.7879173.600096
HomeodomainSEAL-BG0.1%3.8063653.733254×10373.733254\times10^{37}0.39257599.999998%33.8415903.308710
HomeodomainArBG0.2%2.4426441.521578×10591.521578\times10^{59}0.61466699.999999%314.2612263.369103
HomeodomainSEAL-BG0.2%6.4982533.736994×10373.736994\times10^{37}0.27769899.999999%20.8694673.273777

In relative terms, SEAL-BG gives better weight concentration. Across the clipped settings SEAL-BG has higher ESS, lower log-weight variance, lower maximum weight, and lower removed mass, although the absolute values remain low for both methods, illustrating the limitation that these metrics can be dominated by a small number of samples. It also has lower E-W2 at all thresholds and lower T-W2 under clipping. The main comparison is therefore stable across thresholds.

W2 + Q1. Controlled component ablations

We thank the reviewer for this suggestion. Similar to our responses to Reviewers yEYC and Kjyv, we added two controlled ablations. The first replaces SEAL-BG's equivariant encoder with ArBG's plain causal Cartesian Transformer while retaining the local-coordinate head. The second retains the equivariant encoder and replaces the local-coordinate density with a Cartesian density head.

SystemSEAL-BG E-W2Plain backbone E-W2Cartesian density head E-W2
AL30.178 ± 0.0312.708 ± 0.07483.625 ± 0.846
AL40.397 ± 0.1028.999 ± 0.299109.819 ± 1.109
AL60.345 ± 0.05111.058 ± 0.389184.490 ± 0.891
Chignolin1.853 ± 0.175293.578 ± 3.389505.168 ± 3.805
SystemSEAL-BG T-W2Plain backbone T-W2Cartesian density head T-W2
AL30.336 ± 0.0100.483 ± 0.0210.805 ± 0.054
AL40.586 ± 0.0281.168 ± 0.0291.567 ± 0.068
AL61.197 ± 0.0421.787 ± 0.0692.098 ± 0.125
Chignolin2.715 ± 0.0383.907 ± 0.1893.518 ± 0.245

Both replacements increase E-W2 and T-W2 on every system. The Cartesian density head produces the larger E-W2 degradation. These results show that only the combination of the equivariant encoder and local-coordinate density attains the E-W2 and T-W2 of SEAL-BG.

W3 + Q3. Statistical reliability and uncertainty

We thank the reviewer for raising this point. We added SEAL-BG results over 3 seeds with error bars and retained the published uncertainty estimates for all baselines.

MethodAL3 E-W2AL3 T-W2AL4 E-W2AL4 T-W2AL6 E-W2AL6 T-W2Chignolin E-W2Chignolin T-W2
ECNF++2.206 ± 0.8130.962 ± 0.2535.638 ± 0.4831.002 ± 0.06110.668 ± 0.2851.902 ± 0.055——
RegFlow0.853 ± 0.1051.577 ± 0.1403.277 ± 0.5462.342 ± 0.102————
SBG (SMC)0.598 ± 0.0840.503 ± 0.0291.007 ± 0.3821.039 ± 0.0691.189 ± 0.3571.444 ± 0.14010.819 ± 7.2063.778 ± 0.440
FALCON-A1.385 ± 0.1820.343 ± 0.0042.929 ± 0.0681.094 ± 0.0341.211 ± 0.1051.163 ± 0.112——
FALCON0.544 ± 0.0130.452 ± 0.0110.686 ± 0.0470.858 ± 0.0770.892 ± 0.3111.256 ± 0.132——
GIVT1.354 ± 0.0580.343 ± 0.0081.033 ± 0.4491.113 ± 0.1001.206 ± 0.0561.527 ± 0.04845.646 ± 20.9893.031 ± 0.098
MoL-PixelCNN++0.506 ± 0.0821.024 ± 0.6861.643 ± 0.5041.415 ± 0.1101.429 ± 0.1861.264 ± 0.205140.717 ± 49.1133.391 ± 0.093
GMM-PixelCNN++0.249 ± 0.0250.364 ± 0.0161.434 ± 0.7830.806 ± 0.0561.164 ± 0.0371.285 ± 0.05823.339 ± 6.4853.007 ± 0.086
ArBG0.202 ± 0.0100.312 ± 0.0030.449 ± 0.0300.592 ± 0.0100.328 ± 0.1221.094 ± 0.0521.723 ± 0.0752.632 ± 0.044
SEAL-BG0.178 ± 0.0310.336 ± 0.0100.397 ± 0.1020.586 ± 0.0280.345 ± 0.0511.197 ± 0.0421.853 ± 0.1752.715 ± 0.038

Across the four systems, SEAL-BG stays close to ArBG in both E-W2 and T-W2 while consuming 39.807, 50.666, 76.437, and 346.910 PFLOPs, versus 463.856, 605.015, 1,053.223, and 11,891.405 PFLOPs for ArBG. This balance between comparable accuracy and lower training cost makes SEAL-BG better suited to scaling up system size and cheaper free-energy calculations.

W4. Missing limitations

We thank the reviewer for raising these points. We will discusses the limitations concerning energy-component agreement and the fixed generation order in conclusion.

Finally, we are grateful for the reviewer's constructive assessment, which led us to strengthen the empirical evidence and sharpen our claims. We hope the revisions resolve the concerns raised. In addition, following a suggestion from Reviewer yEYC, we trained a transferable SEAL-BG model, which performs strongly on unseen peptide systems. Those interested can find further details in our response to Reviewer yEYC. We would appreciate the reviewer's consideration of an increased score.

Reviewer_KjyvOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

In this paper, the authors introduce SEAL-BG, an autoregressive Boltzmann generator that separates geometric perception from probabilistic generation. To this end, they train a causal SE(3)-equivariant Transformer to encode the Cartesian coordinates of previously placed atoms and a density head to model the next atom as bounded residuals around force-field reference geometry. For likelihood estimation, an analytic Jacobian converts coordinate density to exact density over the Cartesian coordinates. They show the efficacy of this method on ArBG peptide benchmarks and also on larger systems like Homeodomain.

Critical strengths
  1. The model's design is clearly motivated, with each component having a specific role. In addition, the normalization and covariance arguments, the units correction, etc. are also correctly presented.

  2. The results on the released benchmarks are better than ArBG on energy distance with exact likelihoods while scaling up to proteins with 947 atoms.

  3. The local-coordinate parametrization using Gaussians for stiff bond/angle variables provides the right context for generating physically plausible and valid molecules.

Critical weaknesses

Lack of coverage metrics

The authors do not report effective sample size, log-weight variance, or sensitivity to the clipping fraction. In addition, coverage metrics like basin occupancy, free-energy surfaces along slow coordinates, and RMSD-to-native-distributions are not presented. If Boltzmann generation is the main claim, including some form of coverage metrics is important. T-W2, which averages over torsion space do not reveal missed states.

Improvements on larger systems are overstated

On TRP-cage, total overlap improves from 0.863 -> 0.893, and SEAL-BG is worse than ArBG on bond (0.79 vs 0.89) and Coulomb (0.76 vs 0.96). On Homeodomain, ArBG's collapse is largely the chirality failure; SEAL-BG's own bond (0.53) and LJ (0.45) overlaps are poor, with bond energies shifted low and LJ high. Physicality is shown only through energy marginals; no direct bond-length, clash, or secondary-structure statistics are given.

Missing key ablations

The authors claim that separating equivariant perception from local-coordinate generation drives the improvement, but the only ablation removes LDR. An ablation with a non-equivariant encoder and/or a Cartesian mixture head inside SEAL-BG's own pipeline is needed to support the main claims.

Questions for authors
  1. Can the authors add an ablation that replaces the equivariant encoder with a non-equivariant Transformer, and/or the local-coordinate head with a Cartesian mixture head, keeping the LDR and all training settings fixed?

  2. Can the authors provide a more detailed computational efficiency benchmark? Ideally, the authors should compare training FLOPs, A100 GPU-hours, parameter counts, and steps for every method in Figure 3.

  3. What is the effective sample size (or log-weight variance) for each system before and after clipping?

  4. Is there any explanation for the low bond and LJ overlaps in Homeodomain?

  5. Can the authors also provide essential coverage metrics to show that their boltzmann generator recovers missing states?

3 comments

We thank the reviewer for the detailed response. We address each weakness and question below.

W1 (importance-weight diagnostics) + Q3. ESS, weight variance, and clipping sensitivity

We thank the reviewer for this request. Our original decision not to report these metrics followed the ArBG paper, which cautions that ESS is not a standalone measure of Boltzmann sampling quality, since ESS can favor mode-seeking proposals and, in high dimensions, may be dominated by a few overlap samples or numerical outliers. The same limitation applies to log-weight variance, maximum normalized weight, and removed weight mass, which characterize weight concentration but do not establish conformational coverage. We nevertheless evaluated full SNIS and the 0.1% and 0.2% clipping fractions. The complete results are below.

SystemMethodClippingESS ↑Log-weight variance ↓Max weight ↓Removed mass ↓E-W2 ↓T-W2 ↓
Trp-cageArBG0%1.0000006.726835×10446.726835\times10^{44}1.0000000%154.6844303.803001
Trp-cageSEAL-BG0%1.0040546.762883×10316.762883\times10^{31}0.9979780%23.6980522.142261
Trp-cageArBG0.1%6.5469266.733569×10446.733569\times10^{44}0.28004599.999999999999%21.4358631.939085
Trp-cageSEAL-BG0.1%9.3826746.769653×10316.769653\times10^{31}0.18667999.999141%16.5549931.828551
Trp-cageArBG0.2%10.1919526.740316×10446.740316\times10^{44}0.20235399.999999999999%14.4391071.744697
Trp-cageSEAL-BG0.2%17.6473946.776436×10316.776436\times10^{31}0.10052999.999857%7.6908121.732304
HomeodomainArBG0%1.0000091.518536×10591.518536\times10^{59}0.9999950%327.3937723.755004
HomeodomainSEAL-BG0%1.0000353.729522×10373.729522\times10^{37}0.9999820%51.1802813.775349
HomeodomainArBG0.1%2.5135241.520055×10591.520055\times10^{59}0.56342899.999999%326.7879173.600096
HomeodomainSEAL-BG0.1%3.8063653.733254×10373.733254\times10^{37}0.39257599.999998%33.8415903.308710
HomeodomainArBG0.2%2.4426441.521578×10591.521578\times10^{59}0.61466699.999999%314.2612263.369103
HomeodomainSEAL-BG0.2%6.4982533.736994×10373.736994\times10^{37}0.27769899.999999%20.8694673.273777

In absolute terms, both methods show severe weight degeneracy. ESS remains low, log-weight variance is extremely large, and clipping removes nearly all original weight mass, validating that the caution raised by ArBG applies in our setting, namely that these metrics are unreliable as standalone measures of sampling quality. Relative to ArBG, however, SEAL-BG achieves lower E-W2 at every clipping fraction. It also has higher ESS, lower log-weight variance, and lower maximum normalized weight across all tested fractions, as well as lower T-W2 at both clipped settings.

W1 (coverage metrics) + Q5. TICA coverage and RMSD-to-native distributions

We thank the reviewer for this question and address it with two analyses. First, we added a TICA-based coverage analysis that compares the Trp-cage free-energy landscape of MD with those of the generated ensembles in the first two TICs (Figure 7 in Appendix D). The SEAL-BG landscape contains low-free-energy regions near all three numbered regions of the MD projection. This provides a projected coverage check that aggregate T-W2 can obscure.

Second, we compare CA-RMSD-to-native distributions with the MD distribution:

SystemMethodMedian RMSD (nm)95th percentile (nm)W1 ↓W2 ↓
Trp-cageArBG0.26080.29580.00170.0234
Trp-cageSEAL-BG0.25890.28840.00300.0082
HomeodomainArBG0.40420.42470.04310.2636
HomeodomainSEAL-BG0.40300.41870.00270.0320

SEAL-BG has lower W2 on both systems and lower W1 on Homeodomain. These diagnostics provide complementary checks of slow-coordinate coverage and native-structure agreement.

W2 + Q4. Large-system gains and physicality

We thank the reviewer for this comment. We agree that some component-energy overlaps remain lower for SEAL-BG. However, we consider overall total-energy coverage and training efficiency to be the key factors for downstream tasks, particularly faster and more accurate free-energy calculations. On these criteria, SEAL-BG performs favorably, combining higher total-energy overlap and lower high-energy overflow with 1,527.998 versus 27,861.994 PFLOPs on Trp-cage and 13,514.542 versus 141,382.191 PFLOPs on Homeodomain.

For physicality and secondary-structure statistics, we also added frame-level bond, angle, clash, and DSSP diagnostics:

SystemMethodBond >25%Angle >40°Clash r/sigma < 0.65H / E / C (%)
Trp-cageMD0.00%0.00%0.00%37.33 / 0.00 / 62.67
Trp-cageArBG4.02%3.47%3.17%37.45 / 0.02 / 62.53
Trp-cageSEAL-BG0.37%0.53%1.60%38.18 / 0.00 / 61.82
HomeodomainMD0.00%0.00%0.00%40.29 / 0.00 / 59.71
HomeodomainArBG15.02%12.20%12.88%39.34 / 0.00 / 60.65
HomeodomainSEAL-BG0.26%0.52%6.00%39.59 / 0.01 / 60.40

SEAL-BG has substantially lower hard bond, angle, and clash rates on both systems. Both methods preserve secondary-structure composition close to MD, while SEAL-BG combines this preservation with better local covalent geometry.

W3 + Q1. Missing controlled ablations

We thank the reviewer for this request. Similar to our response to Reviewer yEYC, we added two controlled ablations using identical training and evaluation settings.

The first replacement uses ArBG's plain causal Cartesian Transformer with SEAL-BG's local-coordinate head. The second retains the equivariant encoder and uses a Cartesian density head.

SystemSEAL-BG E-W2Plain backbone E-W2Cartesian density head E-W2
AL30.178 ± 0.0312.708 ± 0.07483.625 ± 0.846
AL40.397 ± 0.1028.999 ± 0.299109.819 ± 1.109
AL60.345 ± 0.05111.058 ± 0.389184.490 ± 0.891
Chignolin1.853 ± 0.175293.578 ± 3.389505.168 ± 3.805
SystemSEAL-BG T-W2Plain backbone T-W2Cartesian density head T-W2
AL30.336 ± 0.0100.483 ± 0.0210.805 ± 0.054
AL40.586 ± 0.0281.168 ± 0.0291.567 ± 0.068
AL61.197 ± 0.0421.787 ± 0.0692.098 ± 0.125
Chignolin2.715 ± 0.0383.907 ± 0.1893.518 ± 0.245

Both replacements increase E-W2 and T-W2 on every system. The Cartesian density head has the larger E-W2 degradation. The result shows that removing either the equivariant encoder or the local density introduces a substantially harder learning problem.

Q2. Detailed computational-efficiency benchmark

We thank the reviewer for this request. We now provide a detailed benchmark for every system-method pair.

SystemMethodTraining steps (k)Training PFLOPsA100 hoursParams (M)
AL3ECNF++196850.75820.886—
AL3RegFlow98 + 588310.11925.058—
AL3SBG196574.88815.33029
AL3ArBG98463.85610.6797.4
AL3SEAL-BG1039.8070.60021.695
AL4ECNF++1961,381.26634.026—
AL4RegFlow98 + 588388.56125.829—
AL4SBG196736.55318.57764
AL4ArBG98605.01513.93710.5
AL4SEAL-BG1050.6660.72421.698
AL6ECNF++1963,116.62677.412—
AL6SBG1962,485.48147.28364
AL6ArBG1961,053.22323.19710.5
AL6SEAL-BG1076.4370.97321.704
ChignolinSBG19610,034.279192.918114
ChignolinArBG19611,891.405220.21439.9
ChignolinSEAL-BG20346.9104.35021.726
Trp-cageArBG19627,861.994205.26546.297
Trp-cageSEAL-BG301,527.99817.30321.768
HomeodomainArBG196141,382.1911,020.73746.637
HomeodomainSEAL-BG6013,514.542143.66221.955

RegFlow uses separate teacher and student stages. Costs exclude data preparation and evaluation. Overall, SEAL-BG requires substantially smaller training budgets than baselines, with the lowest training FLOPs and A100 hours on every system.

Finally, we sincerely appreciate the reviewer's detailed feedback, which has helped us improve the paper. We hope the additional evidence and revisions clarify the issues raised in your review. In addition, inspired by Reviewer yEYC's suggestion, we developed a transferable SEAL-BG model that also performs strongly on unseen peptides. If you are interested, further details are available in our response to Reviewer yEYC. We would be grateful if you would consider raising your score accordingly.

Reviewer_yEYCOpenReview ↗
Rating
3
Confidence
2
Informativeness
3
Presentation
3
Soundness
2
Read review
Paper summary

The authors propose SEAL-BG, an autoregressive Boltzmann generation approach for sampling equilibrium conformational ensembles of peptides and proteins. Improving on ArBG (Rehman et al. 2026), SEAL-BG introduces multiple architectural, modeling and training choices, such as atom-level generation with an SE(3)-equivariant encoder, local-coordinate density modeling (continuous bond lengths and angles, binned torsions) with analytic Jacobians, and log-dispersion regularization. The performance of SEAL-BG is tested on multiple systems of varying sizes, such as AL3, AL4, AL6, Chignolin, Trp-cage, and Homeodomain. The model demonstrates competitive performance when compared with multiple baselines on the small peptides (including ArBG, the sole baseline on the two larger systems), improved energy-distribution agreement on the larger systems, and significantly reduced training costs overall.

Critical strengths
  1. Although SEAL-BG builds directly on ArBG, the core contribution is novel. The improvisations are multifaceted: incorporating SE(3)-equivariant encoder, local-coordinate density modeling, and log-dispersion regularization, etc.
  2. The improvements and competitive performance are recorded for peptides with varying sizes, from simple peptides to larger proteins.
  3. The computational costs are significantly lower compared to all baselines.
  4. SEAL-BG generates much fewer outlier candidates compared to ArBG.
  5. The authors perform an additional experiment (alchemical free energy estimation) to demonstrate the practicality of the model.
  6. Overall, the paper is well-written and easy to follow, and the results are mostly presented well. The notations used across the paper are generally consistent.
Critical weaknesses

Major Limitations

  1. The paper introduces multiple enhancements over ArBG at once, but only LDR is ablated. It is therefore difficult to determine which components are responsible for the improved performance and the reduced training cost.
  2. The main tables report no uncertainty. ArBG reports uncertainty estimates, and some of SEAL-BG’s gains on the small peptides fall within those ranges, so without error bars the significance of the results cannot be assessed.
  3. The gains over ArBG are uneven across systems. On Chignolin, SEAL-BG is slightly worse. On Trp-cage, energy overlap improves only marginally. For Homeodomain the failure is likely due to ArBG’s mirror-image failure, but it is unclear how SEAL-BG avoids this failure mode.

Other concerns

  1. The order of generation is fixed, and this is not highlighted as a limitation.
  2. It looks like a fresh model is trained for each system. It is not clear how practical this is. Can a model trained on one system transfer to another?
  3. The model sizes of SEAL-BG and ArBG baselines are not mentioned, and the performance improvement with model size is not shown.
  4. The necessity of autoregressive sampling for this task could be highlighted more clearly. Among the baselines, autoregressive models (GIVT, PixelCNN++) do not consistently outperform non-autoregressive ones. A discussion of this would strengthen the paper.
  5. All reported metrics are distributional distances. Including structural diversity metrics and per-sample quality measures would make the analysis more informative.
Questions for authors
  1. Would augmenting the training set with different atom orderings help, or is fixed ordering essential?
  2. How are the training, validation, and test splits made (randomly or a different strategy)?
  3. Can this method be extended to generating small-molecule conformations too?
  4. How are atom types embedded in the encoder?
  5. How does the Jacobian of the local-to-Cartesian map help in computing the Cartesian conditional density? Is there a derivation for Equation 13?
  6. Why are the remaining baselines (in Table 1) not evaluated on Trp-cage and Homeodomain?
8 comments

We thank the reviewer for the constructive assessment. The additional experiments are now included and addressed below.

Major Limitation 1. Multiple architectural changes are not adequately ablated

Our design pairs an equivariant encoder with a local-coordinate density. For a rotation R∈SO(3)R\in SO(3), the equivariant encoder returns Eθ(Rpi)=(hi,RHi)E_\theta(R\mathbf p_i)=(h_i,RH_i), while the scalar conditioning

Here pi\mathbf p_i denotes the generated Cartesian prefix before atom ii.

ηi=hi+sigmoid⁡(γ)ci\eta_i = h_i + \operatorname{sigmoid}(\gamma)c_i, where ci=RMSNorm⁡(di)c_i = \operatorname{RMSNorm}(d_i) and di=13diag⁡(Hi⊤Hi)d_i = \frac{1}{3}\operatorname{diag}(H_i^\top H_i).

is invariant. The local frame satisfies

ej(Rpi)=Rej(pi)e_j(R\mathbf p_i)=Re_j(\mathbf p_i)

so the local density parameters can be learned from ηi\eta_i and the reconstruction map obeys

Ti′(s,t,ϕ)=RTi(s,t,ϕ).T_i'(s,t,\phi)=RT_i(s,t,\phi).

The resulting Cartesian conditional is compatible with the required rotation covariance.

If we retain the equivariant encoder and replace the local-coordinate density with a Cartesian density, the resulting invariant representation ηi\eta_i carries no information about the applied rotation:

ηi(Rpi)=ηi(pi)\eta_i(R\mathbf p_i)=\eta_i(\mathbf p_i) and ri↦Rri\mathbf r_i\mapsto R\mathbf r_i.

The conditioning stays fixed while the Cartesian target rotates. It is therefore impossible for the model to use one invariant ηi\eta_i to predict the specific rotated target RriR\mathbf r_i. An invariant density can spread mass over all rotations, while it cannot represent the required peaked orientation conditional.

Similarly, if we retain the local-coordinate density and replace the equivariant encoder with a plain Cartesian Transformer, the Transformer provides rotation-dependent features gig_i. The predicted object remains the local coordinate zi=(si,ti,ϕi)z_i=(s_i,t_i,\phi_i), and a rotated local frame leaves ziz_i unchanged. The density head must therefore satisfy

pi(zi∣gi(Rpi))=pi(zi∣gi(pi))p_i(z_i\mid g_i(R\mathbf p_i))=p_i(z_i\mid g_i(\mathbf p_i))

for all rotations RR. The plain Transformer supplies no invariant feature guarantee, so this invariance must be learned from rotation augmentation, reducing training efficiency.

To test the above analysis, we added two ablations while keeping all other settings unchanged. The first uses ArBG's plain causal Cartesian Transformer with the local-coordinate head. The second keeps the equivariant encoder and uses a Cartesian density head.

SystemSEAL-BG E-W2Plain backbone E-W2Cartesian density head E-W2
AL30.178 ± 0.0312.708 ± 0.07483.625 ± 0.846
AL40.397 ± 0.1028.999 ± 0.299109.819 ± 1.109
AL60.345 ± 0.05111.058 ± 0.389184.490 ± 0.891
Chignolin1.853 ± 0.175293.578 ± 3.389505.168 ± 3.805
SystemSEAL-BG T-W2Plain backbone T-W2Cartesian density head T-W2
AL30.336 ± 0.0100.483 ± 0.0210.805 ± 0.054
AL40.586 ± 0.0281.168 ± 0.0291.567 ± 0.068
AL61.197 ± 0.0421.787 ± 0.0692.098 ± 0.125
Chignolin2.715 ± 0.0383.907 ± 0.1893.518 ± 0.245

Both replacements increase E-W2 and T-W2 on every system. The Cartesian density head has the larger E-W2 degradation. The result shows that removing either the equivariant encoder or the local density introduces a substantially harder learning problem.

Major Limitation 2. Main tables lack uncertainty

We thank the reviewer for raising this point. We now include SEAL-BG results over 3 seeds with error bars while retaining the published uncertainty estimates for all baselines.

MethodAL3 E-W2AL3 T-W2AL4 E-W2AL4 T-W2AL6 E-W2AL6 T-W2Chignolin E-W2Chignolin T-W2
ECNF++2.206 ± 0.8130.962 ± 0.2535.638 ± 0.4831.002 ± 0.06110.668 ± 0.2851.902 ± 0.055——
RegFlow0.853 ± 0.1051.577 ± 0.1403.277 ± 0.5462.342 ± 0.102————
SBG (SMC)0.598 ± 0.0840.503 ± 0.0291.007 ± 0.3821.039 ± 0.0691.189 ± 0.3571.444 ± 0.14010.819 ± 7.2063.778 ± 0.440
FALCON-A1.385 ± 0.1820.343 ± 0.0042.929 ± 0.0681.094 ± 0.0341.211 ± 0.1051.163 ± 0.112——
FALCON0.544 ± 0.0130.452 ± 0.0110.686 ± 0.0470.858 ± 0.0770.892 ± 0.3111.256 ± 0.132——
GIVT1.354 ± 0.0580.343 ± 0.0081.033 ± 0.4491.113 ± 0.1001.206 ± 0.0561.527 ± 0.04845.646 ± 20.9893.031 ± 0.098
MoL-PixelCNN++0.506 ± 0.0821.024 ± 0.6861.643 ± 0.5041.415 ± 0.1101.429 ± 0.1861.264 ± 0.205140.717 ± 49.1133.391 ± 0.093
GMM-PixelCNN++0.249 ± 0.0250.364 ± 0.0161.434 ± 0.7830.806 ± 0.0561.164 ± 0.0371.285 ± 0.05823.339 ± 6.4853.007 ± 0.086
ArBG0.202 ± 0.0100.312 ± 0.0030.449 ± 0.0300.592 ± 0.0100.328 ± 0.1221.094 ± 0.0521.723 ± 0.0752.632 ± 0.044
SEAL-BG0.178 ± 0.0310.336 ± 0.0100.397 ± 0.1020.586 ± 0.0280.345 ± 0.0511.197 ± 0.0421.853 ± 0.1752.715 ± 0.038

SEAL-BG achieves results comparable to ArBG in E-W2 and T-W2 on these systems while using 39.807, 50.666, 76.437, and 346.910 PFLOPs, compared with 463.856, 605.015, 1,053.223, and 11,891.405 PFLOPs for ArBG, which demonstrates an efficiency advantage when scaling to larger systems and performing free-energy calculations.

Major Limitation 3. Uneven gains and the Homeodomain mirror failure

We thank the reviewer for this important point. We agree that ArBG remains better on Chignolin and that the Trp-cage total-energy-overlap improvement is modest. Overall, we emphasize that SEAL-BG provides accuracy comparable to ArBG with a substantially lower training budget, which can help make free-energy calculations less expensive. While differences may be limited on smaller systems such as Chignolin, we expect the accuracy gains of SEAL-BG over ArBG to become more pronounced on larger systems and more complex tasks, such as the transferable setting discussed later. We will revise the wording to make this positioning explicit.

On Homeodomain, approximately half of raw ArBG proposals have inverted handedness. To address this, SEAL-BG uses an SE(3)-equivariant encoder together with right-handed local frames and signed torsions. SE(3) removes the mirror-reflection component of E(3), so a Homeodomain structure and its mirror can produce different ηi\eta_i, enabling the model to distinguish the two structures and generate the correct one more easily.

Other Concern 1 + Question 1. Fixed generation order and alternative atom orderings

We follow ArBG and use a fixed residue-by-residue N→C\mathrm{N}\rightarrow\mathrm{C} generation order. Although a fixed generation order can limit the flexibility and may affect performance, we consider this order transferable across systems because different molecules can be factorized according to this ordering scheme, allowing the model to learn a universal generation order. As described in our response to the next question, we followed ArBG to develop a transferable SEAL-BG model using the same ordering scheme as described above and achieve strong performance, which demonstrates the transferability of this generation order.

We thank the reviewer for the insightful question on whether augmenting the training set with different atom orderings would help, which has inspired us to investigate this direction further. We see this as a promising direction because training across multiple atom orderings could expose the model to more diverse conditional dependencies, improve its robustness to the choice of factorization, and potentially improve generation quality. Although the review timeline did not allow us to complete these randomized-order experiments, we will continue this investigation and include the results in the camera-ready version.

Other Concern 2. Fresh models per system and cross-system transfer

We thank the reviewer for this question, which inspired us to add a transferable experiment. The answer is yes. After training on a collection of peptide systems, the model predicts the distributions of unseen peptide systems and achieves strong performance. Specifically, following ArBG, we train a single transferable SEAL-BG model without system-specific parameters and report zero-shot results on unseen peptides.

Method4AA E-W24AA T-W24AA TICA-W28AA E-W28AA T-W28AA TICA-W2
TarFlow0.9290.7760.49810.8262.3201.057
Prose0.6460.6070.3499.3602.0190.960
Robin (Transferable ArBG)0.5310.6490.3793.6151.9020.882
Transferable SEAL-BG0.5190.5900.4592.8511.7640.868

Transferable SEAL-BG achieves the best E-W2 and T-W2 at both lengths and the best TICA-W2 at 8AA with 18.000 EFLOPs of training compute, compared with 112.184 EFLOPs for Robin. Thus, Transferable SEAL-BG achieves stronger performance on this more challenging transfer setting while using a smaller training budget.

Comments on the paper

3 comments

Kjyv: if the authors deliver the component ablations and the ESS diagnostics, would that move you to accept? Or do the Trp-cage and Homeodomain energy-overlap results stop you on their own?

Gur6 and yEYC: you both rated the paper weak accept despite the missing ablations. Is your score based mainly on the compute savings? Would results showing the gains come from one component, or are within seed noise, change your view?

Upon reading other reviews and re-reading my own after a few weeks, I feel like I might have been overenthusiastic about the paper. There is a general sense that some key ablations are missing. I'll wait to see if the authors respond. Otherwise, I am leaning towards adjusting my score to a weak reject.

We thank the reviewer for this concern. We added a mathematical analysis and controlled ablations showing that each component is essential. Replacing the equivariant encoder or the local-coordinate density increases both E-W2 and T-W2 on all four systems, confirming that the matched pairing drives the gains. We hope this addresses the concern and would be grateful if the reviewer would reconsider the current rating.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.