- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces a MOF-conditioned Boltzmann generator for dilute-limit CO₂ adsorption calculations. The model parameterizes a normalized proposal over molecular position, orientation and internal deformation, using pretrained MLIP features and a shared position–orientation score. Importance weighting enables Henry-coefficient estimation under the chosen MLIP. Experiments demonstrate substantial sampling gains across held-out MOFs.
Critical strengths
-
The problem is well motivated. Uniform insertion wastes expensive MLIP evaluations on unfavorable configurations. Learning a transferable proposal directly addresses this bottleneck.
-
The probabilistic formulation is technically careful. The method explicitly handles periodicity, coordinate Jacobians and oxygen-exchange symmetry, which are essential for valid density evaluation and importance weighting.
-
The computational results are promising. A shared model transfers to 672 held-out MOFs without per-material retraining and achieves high sampling efficiency across adsorption-strength quartiles. Caching material features makes repeated sampling inexpensive.
-
The paper appropriately acknowledges that efficient guest sampling does not establish converged adsorption estimates for fully flexible frameworks.
Critical weaknesses
-
Methodological novelty is limited and insufficiently isolated. Conditional density factorization, mixture distributions, pretrained equivariant features and importance sampling are established tools. The main task-specific contribution appears to be their integration, particularly the shared position–orientation score. However, the ablations do not directly test this coupling or compare against a simpler normalized joint pose model. Consequently, the necessity of the distinctive design remains unclear.
-
The transfer evaluation is relatively permissive. Splitting by MOF identifier does not establish generalization across structural families, linkers or topologies. All test metals occur in training, and dataset filtering restricts the range of framework sizes and pore accessibility.
-
Reference reliability needs stronger independent validation. Flexible-gas accuracy is evaluated on 594 of 672 MOFs passing a reference-precision threshold. Excluded structures may represent particularly difficult cases. Incorporating model-discovered sites into the reference improves coverage, but particle-bootstrap intervals cannot capture uncertainty from undiscovered modes. Independent sampling checks would strengthen the evidence.
-
The headline speedup does not establish total workflow savings. Approximately 700× acceleration corresponds to the 16-draw operating point. Training-data generation and model training are excluded, and the more accurate configurations have different cost ratios. Equal-error comparisons and amortization analysis are needed for realistic screening workloads.
Questions for authors
-
How much does the shared position–orientation score improve performance over independently predicted factors or a simpler conditional mixture?
-
How does performance change under linker-, topology- or structural-family-based splits?
-
What is the results on reference-unqualified MOFs, and can independent sampling validate dominant-site coverage?
-
At matched estimation error, how many new MOFs must be screened to recover preparation and training costs?
Can the authors address the novelty and generalization of the method used in this paper?
3 comments
Response to Reviewer eXaZ (2/2)
W3 & Q3. How reliable are the reference estimates, how does the method perform on reference-unqualified MOFs, and can independent sampling validate site coverage?
We agree that particle-bootstrap precision alone cannot establish reference convergence, because it cannot detect entirely missed adsorption sites. After submission, we regenerated the references using a model-free initialization built from Widom insertions and geometry-optimized adsorption sites, removing dependence on our learned proposal.
For each MOF, we selected 1,024 distinct low-energy configurations from 1M Widom insertions and optimized them to locate adsorption minima. We supplemented these with optimized configurations from a preliminary model-free AIS run and constructed Hessian-based local Gaussian proposals around the discovered sites. Appendix F, “AIS reference generation,” details the initialization, annealing schedule, production sampling, and bootstrap intervals.
After submission, we also generated new sequential Monte Carlo (SMC) training data with 4,096 flexible CO₂ configurations per training MOF and retrained the same architecture. Figure 1 and Table 2 report the retrained model against the new references.
| Metric across 672 MOFs, flexible CO₂ | Original reference | Updated reference |
|---|---|---|
| MOFs with bootstrap uncertainty ↑ | 405 | 647 |
| MOFs with bootstrap uncertainty ↑ | 594 | 668 |
| MOFs with ↑ | 637 | 672 |
Here, is the lowest sampled energy and is the lowest energy found by geometry optimization. These energy comparisons assess whether sampling reaches the discovered low-energy regions, independently of bootstrap precision.
For reference-unqualified MOFs, accuracy cannot be reliably assessed because the reference values themselves remain insufficiently resolved. We therefore provide updated evaluations using the more reliable references, expanding the evaluation set from 594 to 668 MOFs.
W4 & Q4. At matched estimation error, how many new MOFs must be screened to recover data-generation and training costs?
We agree that inference speedup alone does not establish total workflow savings. We therefore estimated the one-time preparation cost and the number of new MOFs needed to recover it at comparable estimation error.
| Preparation stage, 6,052 training MOFs | GPU-hours |
|---|---|
| Widom screening, 100,000 insertions per MOF | 649 |
| Geometry optimization of adsorption sites | 407 |
| Site Hessian calculations | ≈32 |
| SMC training-data generation | 180 |
| Feature extraction | ≈1 |
| Model training | 17 |
| Total | ≈1,290 |
Preparation costs from a single H200 GPU.
| Approximate mean | Ours, draws / GPU-s per MOF | Widom-initialized AIS, particles / GPU-s per MOF | Inference speedup | Break-even new MOFs |
|---|---|---|---|---|
| 0.11 | 32 / 0.50 | 4,096 / 1,075 | ≈2,100× | ≈4,300 |
| 0.08 | 64 / 0.61 | 8,192 / 1,750 | ≈2,900× | ≈2,700 |
The comparison uses flexible CO2 on 665 reference-qualified test MOFs against the updated model-free references. Inference costs use the H200 timing basis of Figure 1. Ours includes feature and context construction, and the AIS baseline includes its initial 100,000 Widom insertions.
We calculate the break-even point as , where is the one-time preparation cost and is the inference cost per new MOF. Screening approximately 2,700–4,300 additional MOFs therefore recovers preparation and training costs at these accuracy levels. Larger campaigns benefit from applying the shared model without per-MOF retraining.
The extrapolation results in Q2 further support reuse of the trained model across new metals, linkers, topologies, and larger frameworks. The preparation cost can therefore be amortized across successive screening campaigns rather than incurred separately for each new MOF or test set, provided the target energy function and thermodynamic conditions remain unchanged.
Dear Reviewer eXaZ,
Thank you again for your thoughtful review. We recently posted our response and additional experimental results. With the author-reviewer discussion period closing today (~ 13hr left), we would appreciate knowing whether these have addressed your concerns, or whether any points still need clarification.
Thank you
Response to Reviewer eXaZ (1/2)
We appreciate the reviewer’s suggestions for isolating the architectural contribution and strengthening the generalization, reference-validation, and cost analyses. We provide new shared-score ablations, OOD evaluations, improved model-free AIS references, and a workflow cost analysis. Manuscript Figure 1 and Table 2 reflect the updated evaluation. The AIS reference-generation protocol is provided in Appendix F. Manuscript changes are highlighted in blue. Additional experimental results will be incorporated into the revised manuscript.
W1 & Q1. What is the methodological novelty, and how much does the shared pose score improve over simpler normalized pose models?
We tested the contribution of the shared position–orientation score against two simpler normalized alternatives, retraining each with the same protocol.
Results on the test MOFs are shown below.
All evaluations use 32,768 samples per MOF, with Q1–Q4 denoting adsorption-strength quartiles. The shared score improves sampling efficiency in every quartile for both flexible and rigid CO₂. Overall, it achieves approximately 1.8× the mean nESS of (A) and 8.7× that of (B). These ablations isolate the contribution of the shared score beyond the use of normalized mixture distributions alone.
W2 & Q2. Does the method generalize across MOF families, linkers, and topologies under more demanding train–test splits?
We added extrapolation tests by excluding selected metals, linkers, or topologies from training and retraining with the same protocol. We selected frequent groups in our dataset and evaluated on the corresponding original test MOFs with reference bootstrap uncertainty ≤0.2.
Arrows compare the model trained on all groups with the model retrained after excluding the specified group. Accuracy and sampling efficiency are largely maintained for unseen linkers and topologies. Metal exclusion additionally requires generalization to elements absent from the proposal’s training data and causes a larger reduction in sampling efficiency.
For size extrapolation, we randomly selected 200 additional MOFs with 201–300 atoms per unit cell using the same pore-accessibility criteria and generated new references. The model trained on MOFs with at most 200 atoms was evaluated without retraining.
All evaluations use 32,768 samples per MOF and references with bootstrap uncertainty ≤0.2. The model maintains strong accuracy and sampling efficiency on larger MOFs.
Together, these results demonstrate that the learned proposal generalizes beyond the original training distribution, maintaining strong accuracy and sampling efficiency across unseen metal elements, linkers, topologies, and larger frameworks without adapting the model to the test MOFs.