- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AdsorbSample treats adsorbate placement as conditional sampling from a restrained Boltzmann target defined by a pretrained ML interatomic potential. A surface-conditioned source and typed equivariant controller generate full adsorbate Cartesian coordinates, allowing internal conformational changes. OC20 IS2RE pretraining is followed by energy/force-based Flow Sampling without dense OC20-Dense placement targets. Candidates undergo bond-restrained UMA relaxation, validity filtering, and unrestrained-energy ranking. On 44 ID and 50 OOD systems, the method improves MLIP Pass@k and generally improves low-budget DFT single-point success over AdsorbML/AdsorbDiff. Additional analyses study source/pretraining choices, controller architecture, joint surface sampling, and single-system motif replay and flexible-adsorbate examples.
Critical strengths
- Learning from an available MLIP energy landscape addresses a meaningful supervision bottleneck in catalyst configuration search. Full-coordinate generation, explicit bond topology, surface conditioning, and separate interaction branches form a well-motivated application of energy-trained sampling. The distinction between sparse geometric pretraining and the absence of dense placement supervision during energy training is stated clearly. This is a useful contribution even without introducing a new general-purpose sampling objective.
- The evaluation separates structural validity, configurational diversity, MLIP discovery, and DFT single-point verification. Applying bond-restrained relaxation to all main comparators is a valuable fairness control, and Appendix C.3 also reports unconstrained relaxation. Low-budget improvements are substantial: DFT SR@1 rises from 13.6% to 25.0% on ID and from 18.0% to 28.0% on OOD relative to AdsorbML. The architecture and modeling ablations, including the unsuccessful joint-surface variant, help identify which design choices matter. These results support weak acceptance as a promising scientific-ML method with useful empirical evidence.
Critical weaknesses
- The uncertainty and physical scope of the DFT evidence need stronger qualification. Results use only 44 ID and 50 OOD systems; DFT SR@k selects from the first k samples in seed/frame order, without reported uncertainty over sample ordering or model training. Several differences represent only a few systems, and DFT superiority is not uniform: at k=10 the ID result is 56.8% versus AdsorbML's 63.6%, with an OOD tie at 52.0%. Moreover, Appendix C.3 retains bond restraints without a final unconstrained relaxation, and C.4 performs DFT single points without ionic relaxation. This supports candidate-energy discovery, but does not yet establish the same ranking for fully relaxed DFT adsorption minima.
- The strongest evidence for flexible-adsorbate search and mode-collapse recovery comes from separately trained single-system models. The GGE experiment additionally changes temperature, adds system-specific geometric restraints, and performs endpoint refinement before replay (Appendix D.4). It demonstrates feasibility, but does not isolate the benefit of full-coordinate sampling or establish amortized generalization to larger flexible adsorbates. This distinction matters because internal conformational search is a central motivation; the current broad claims should remain tied to the tested settings.
Questions for authors
- How were the 44 ID and 50 OOD systems selected from OC20-Dense? Can paired system-level uncertainty and the sensitivity of DFT SR@k to candidate ordering be reported using existing evaluations?
- For a representative subset, do low-energy discoveries and method rankings persist after releasing the bond restraint and performing DFT ionic relaxation? If such results are unavailable, please delimit the adsorption-minimum claim accordingly and report residual physical forces where available.
- In the GGE example, can the rigid-placement baseline receive the same applicable restraints and endpoint-refinement budget, and how much training/MLIP-query compute does the single-system sampler require? This would clarify the incremental conformational-search benefit under a comparable resource budget.
3 comments
Thank you for the clarifications and additional experiments. The analysis across candidate orderings and the new DFT relaxations address my main concerns about the robustness of the results. The minima-hopping comparison is helpful, though the evidence for flexible adsorbates still comes from a single system. I will maintain my rating.
Thank you for reading the revision and for the follow-up. We are glad the new analyses address your main concerns and we appreciate your time and constructive suggestions.
We thank the reviewer for their response. References are to the revised PDF.
W1 and Q1. Uncertainty.The 44 ID and 50 OOD systems are AdsorbDiff’s evaluation subsets of the Open Catalyst Challenge 2023 subset of OC20-Dense, obtained by an 80/20 split of the ID systems and a random sample of 50 of the 200 OOD systems, and we made no further selection (§4). DFT SR@k is now the mean ± std over four candidate orderings (Table 2), and paired bootstrap 95% intervals over systems quantify the uncertainty from the small evaluation set (App. D.2,
L1174–1194; Table 10). Pooled over both splits, the DFT gain over AdsorbML is +9.3 [+3.7, +14.9] points at k=1 and +7.4 [+0.5, +14.4] at k=2, and the two methods are comparable at k=5 and 10 (§5.1). For example, the ID SR@10 gap the reviewer noted (56.8% against 63.6%) came from a single ordering, and over four orderings it becomes 61.4 ± 5.2 against 59.7 ± 3.4.W1 and Q2. Restraint release and DFT relaxation.The ranking of methods persists in both tests, and DFT relaxation confirms the below-reference discoveries (App. D.1,
L1092–1162; Tables 6–9). After releasing the restraint on all candidates, about 95% of structures of every method are UMA minima (Table 6), AdsorbSample keeps the highest Pass@k at every budget (Table 7), and its DFT SR@k changes by less than 3 points (Table 8). Under DFT ionic relaxation, every SR@1 single-point success persists for all three methods tested (L1126–1131), so single-point SR@1 is, if anything, conservative. Of the 22 basins that AdsorbSample keeps at least 0.1 eV below the reference after release, DFT relaxation confirms 20, against 6 of 8 for AdsorbML (Table 9). Residual forces are reported in Table 6.W2 and Q3. Flexible-adsorbate evidence.We agree, and now present these as single-system case studies (§5.3,
L451–513), with the extension to amortized models listed as future work (conclusion,L527–529). As a control, we ran constrained minima hopping (CMH) with UMA and the same GGE restraints under two budgets (§5.3; App. E.4, Table 16). Both flexible methods recover the two-ring geometry and rigid placement does not. The sampler trains in 11 A100 GPU-hours with about 60k UMA evaluations. At matched GPU time, where CMH uses about six times as many evaluations, CMH returns 18 passing minima in 7 basins and AdsorbSample returns 5 in 5. At matched UMA evaluations (2 GPU-hours of CMH), CMH returns 2 passing minima in 1 basin. AdsorbSample therefore finds more basins per energy evaluation, and CMH finds more per GPU-hour once training cost is counted.The case study thus shows that an energy-trained diffusion sampler scales to a 43-atom adsorbate with seven rotatable bonds and reaches the same low-energy mode as a dedicated global optimizer, with fewer energy evaluations. Unlike CMH, whose cost is paid in full for each new system, the sampler's cost is mostly training, which a conditional model could in principle amortize across systems. We have revised §5.3 to state this comparison explicitly (
L507–513).