- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper aims to predict binding affinities for CB[7]-based host-guest complexes, which is a relatively unexplored domain in ML, and introduces CB7Mol. CB7Mol is a binding affinity prediction model that considers (1) molecular encoder training with alignments with chemical knowledge, (2) complex-level pre-training with flexibility, and (3) cross-host calibration. The results show improvements over the considered baselines. The authors also conduct wet-lab validation using competition NMR.
Critical strengths
-
Well-motivated methodology for an unexplored task. This paper addresses binding affinity predictions for an under-explored domain in ML: CB[7]. This moves beyond conventional protein-ligand binding affinity prediction and considers binding affinity between non-polymer entities. The proposed components, e.g., chemical knowledge alignment and binding-related pre-training, are well-motivated.
-
Wet-lab results. The proposed method shows clear improvements over considered baselines, and the individual components are well-supported by ablations. Moreover, the paper validates their predictions using wet-lab experiments.
Critical weaknesses
- Lack of comparison with MD-based methods. Since CB[7] host-guest complexes are relatively small, molecular dynamics (MD)-based binding affinity computations should be considered. Although MD cannot be widely used for huge systems such as protein-ligand complexes, MD provides accurate binding affinity estimates, making it a feasible option for CB[7] host-guest complexes, which are typically smaller than conventional protein-ligand complexes.
Questions for authors
- I was wondering how the prediction heads of the baselines are implemented. Do they share an architecture across different models?
- The proposed method seems applicable to general molecular binding affinity prediction. Why do the authors focus only on CB[7]? Does it also work well for other host-guest systems?
- I was wondering whether the performance is sensitive to the set of cross-hosts in cross-host calibration.
5 comments
Reply to Reviewer qp1V (Part 2)
Q3: Sensitivity to the set of cross-hosts
The performance is sensitive to the cross-host set, and the sensitivity depends on the binding mechanism compatibility of cross-hosts used during calibration. We have reported the sensitivity of CB7Mol to different sets of training hosts in Figure 3(c). Empirically, using the full set of compatible hosts is consistently and substantially the best configuration across all three CB[7] evaluation sets. Removal of β-CD and p-SC4 causes severe performance degradation, because they each cover a dominant determinant of CB[7] recognition. β-CD presents a hydrophobic macrocyclic cavity of dimensions comparable to CB[7], while p-SC4 can reproduce cationic recognition similar to CB[7]. This directly reflects the design rationale of cross-host calibration described in Section 3.3, which is to learn the binding determinants shared across mechanistically compatible host–guest systems. The observed sensitivity is therefore expected, where performance improves as the compatible-host set more completely covers recognition determinants of CB[7].
W1: Comparison with MD baselines
Thank you for raising this constructive question. We have run substantial additional experiments. In brief: (1) we add an endpoint MM/GBSA baseline across all three CB[7] evaluation sets; (2) we attempted rigorous MD free-energy calculations and found them to suffer from both systematic bias and numerical instability on CB[7]; and (3) making such calculations reliable would require QM-grade force-field re-parameterization, whose per-molecule cost is prohibitive and cannot be completed within an acceptable timeframe.
(1) Endpoint baseline: MM/GBSA
We add MM/GBSA [5], the cheapest MD-based estimator, as a physics-based endpoint baseline with GAFF2 force field, AM1-BCC charges, and igb=8 implicit solvent, which is evaluated under the same protocol as aISS. We will add the new results in Table 1, which are reported here for your convenience:
| Evaluation set | Method | ρ | τ | RMSE |
|---|---|---|---|---|
| SAMPL4 | MM/GBSA | 0.616 | 0.420 | 1.322 |
| CB7Mol | 0.741±.12 | 0.585±.12 | 1.864±.12 | |
| Expert | MM/GBSA | 0.179 | 0.134 | 1.973 |
| CB7Mol | 0.558±.06 | 0.427±.05 | 1.729±.11 | |
| SupraBench | MM/GBSA | 0.487 ± .10 | 0.360 ± .08 | 2.106 ± .51 |
| CB7Mol | 0.834±.12 | 0.691±.12 | 1.253±.35 |
On the small SAMPL4 set, MM/GBSA shows advantage in prediction precision. For other cases, CB7Mol consistently outperforms simple MD baseline.
(2) Rigorous MD free-energy attempts
We attempted absolute binding free-energy calculations using two standard approaches, both built on the standard small-molecule stack (GAFF2 typing, AM1-BCC charges via antechamber, TIP3P explicit water):
- Attach-Pull-Release (APR) [6] with Boresch 6-DOF orientational restraints;
- Alchemical double-decoupling (DDM) [7] with Hamiltonian replica exchange.
Testing on CB[7] guests from the SAMPL4 benchmark and high-affinity binders reported in our case study, we observed two failure modes:
(a)Systematic bias. Alchemical method tends to predict the wrong sign of binding free-energy. The converged binding affinity estimates ranged from +2.7 to +11.7 kcal/mol, while the experimental results lie between −6 and −17 kcal/mol. On the other hand, formal charge-related over-estimation of binding is observed in APR calculation. For example, the +2 adamantane-diammonium is estimated at ΔG_bind = −43.7 kcal/mol versus experimental −17.2, and the +1 azaspiro at −29.9 versus −14.2.
(b) Numerical instability and convergence failure. The APR calculations were numerically unstable. We summarize the failure statistics on SAMPL4:
| Outcome | Count | Analysis |
|---|---|---|
| NaN | 5 | MD integrator blows up during the pull |
| Non-convergent pull | 5 | physically impossible ΔG_bind of −300 to −800 kcal/mol |
Both failure modes trace to the inappropriate charge modeling. CB[7] recognition is dominated by ion-dipole interactions and the release of high-energy water, while fixed-charge force field with library charges (AM1-BCC) captures neither the polarization response of the portal carbonyls to the guest charges nor the delicate energetics of confined high-energy water [3,8]. This electrostatic mis-balance produces the systematic bias and numerical instability.
Reply to Reviewer qp1V (Part 3)
(3) A reliable fix requires QM-grade force fields with prohibitive per-molecule cost
Correcting the aforementioned failure modes requires deriving the electrostatic forces from per-molecule quantum mechanics, such as QM-density fixed charges (MBIS [3]) and Polarizable force field (AMOEBA [9]). However, these methods require per-molecule QM parameterization, where every new candidate needs its own QM calculation to obtain its parameters. We empirically measured the single-run AMOEBA parameterization cost:
| Molecule | Charge | Time Cost | Disk Requirement |
|---|---|---|---|
| Adamantan-1-amine | +1 | 10–45 min | ~ 0.2 GB |
| 1,6-Hexanediamine | +2 | 8.6 h | ~ 1 GB |
| p-Xylylenediamine | +2 | 21.2 h | ~ 1 GB |
| 2-(2-Aminoethyl)piperazine | +3 | > 48 h | ~ 1 GB |
| CB[7] | 0 | > 90 h | > 150 GB |
Cost grows exponentially with molecular size and charge/flexibility, which is driven by cubic time complexity, harder SCF convergence and per-rotatable-bond torsion scans [9,10]. A reliable MD pipeline for CB[7] would need this per-molecule QM parameterization plus a polarizable free-energy simulation for every candidate. It is infeasible to obtain even a handful of well-tuned results within the rebuttal period.
Finally, we would also like to clarify why we didn’t take MD baselines into account in the first place. CB7Mol targets large-scale guest screening, which does not require high prediction accuracy. In contrast, MD free-energy methods are computationally expensive, and are conventionally used to accurately calculate the binding free-energy of a small number of candidates after faster virtual screening. Our experiments further proved that rigorous MD is not as reliable as we have expected for CB[7]-based host-guest system. We therefore do not consider MD a baseline worth massive investment for the large-scale guest screening problem CB7Mol addresses.
We hope that our clarifications and additional experiments will lead to a reconsideration of your score.
Reference:
[1] Kraft, Albert, Connor R. Schmidt, Christian Akakpo, Frank Biedermann, Matthew J. Webber, and Lyle Isaacs. "Cucurbit [n] uril-type molecular containers." Nature Reviews Methods Primers 6, no. 1 (2026): 40.
[2] Alnajjar, Mohammad A., Werner M. Nau, and Andreas Hennig. "A reference scale of cucurbit [7] uril binding affinities." Organic & biomolecular chemistry 19, no. 39 (2021): 8521-8529.
[3] Gonzalez, Duvan, Luis Macaya, Carlos Castillo-Orellana, Toon Verstraelen, Stefan Vogt-Geisse, and Esteban Vohringer-Martinez. "Nonbonded force field parameters from minimal basis iterative stockholder partitioning of the molecular electron density improve CB7 host–guest affinity predictions." Journal of Chemical Information and Modeling 62, no. 17 (2022): 4162-4174.
[4] Rizzuto, Felix J., Larissa KS von Krbek, and Jonathan R. Nitschke. "Strategies for binding multiple guests in metal–organic cages." Nature Reviews Chemistry 3, no. 4 (2019): 204-222.
[5] Genheden, Samuel, and Ulf Ryde. "The MM/PBSA and MM/GBSA methods to estimate ligand-binding affinities." Expert opinion on drug discovery 10, no. 5 (2015): 449-461.
[6] Henriksen, Niel M., Andrew T. Fenley, and Michael K. Gilson. "Computational calorimetry: high-precision calculation of host–guest binding thermodynamics." Journal of chemical theory and computation 11, no. 9 (2015): 4377.
[7] Boresch, Stefan, Franz Tettinger, Martin Leitgeb, and Martin Karplus. "Absolute binding free energies: a quantitative approach for their calculation." The Journal of Physical Chemistry B 107, no. 35 (2003): 9535-9551.
[8] Amezcua, Martin, Léa El Khoury, and David L. Mobley. "SAMPL7 Host–Guest Challenge Overview: assessing the reliability of polarizable and non-polarizable methods for binding free energy calculations." Journal of computer-aided molecular design 35, no. 1 (2021): 1-35.
[9] Walker, Brandon, Chengwen Liu, Elizabeth Wait, and Pengyu Ren. "Automation of AMOEBA polarizable force field for small molecules: Poltype 2." Journal of computational chemistry 43, no. 23 (2022): 1530-1542.
[10] Smith, Daniel GA, Lori A. Burns, Andrew C. Simmonett, Robert M. Parrish, Matthew C. Schieber, Raimondas Galvelis, Peter Kraus et al. "PSI4 1.4: Open-source software for high-throughput quantum chemistry." The Journal of chemical physics 152, no. 18 (2020).
[11] Rizzi, Andrea, Steven Murkli, John N. McNeill, Wei Yao, Matthew Sullivan, Michael K. Gilson, Michael W. Chiu et al. "Overview of the SAMPL6 host–guest binding affinity prediction challenge." Journal of computer-aided molecular design 32, no. 10 (2018): 937-963.
Reply to Reviewer qp1V (Part 1)
We thank you for your constructive evaluation, and for crediting our well-motivated methodology and wet-lab validation. We address your questions below:
Q1: Prediction head implementation for baselines
We adopt the same prediction head architecture for the same kind of methods. aISS is not a learnable baseline, while QSAR methods are not based on neural networks, so there is no prediction head for physics-driven baselines. For CB7Mol and all other baselines, a two-layer MLP is adopted for prediction, with the same architectural design and different dimensional settings. The main difference lies in the readout design, which depends on different types of input. GNN-based baselines adopt the concatenation of molecular graph representations, molecular relational learning-based baselines concatenate Set2Set molecular representations following their official implementation, while complex-based baselines use the same readout strategy as CB7Mol. We believe that such implementation can facilitate both fair comparison and input utilization.
Q2: Why only focus on CB[7] and performance on other host-guest systems
Thank you for raising this question. We focus on CB[7] for two reasons:
(1) CB[7] is a uniquely important and challenging recognition target. Among synthetic hosts, CB[7] uniquely combines water solubility, biocompatibility, and exceptionally strong and selective binding, underpinning its use in targeted drug delivery and displacement-based biosensing [1]. CB[7] also forms the strongest known synthetic host–guest complexes [2], giving an affinity range that spans many orders of magnitude and governed by subtle physicochemical effects, which require specialized, per-molecule quantum-chemistry-derived electrostatics to capture [3], and therefore remain prohibitively expensive for large-scale screening. CB[7] affinity prediction is thus both high-impact and scientifically hard.
(2) Other macrocyclic hosts have different binding mechanisms, so the task does not transfer by design. For example, CB[8] routinely forms 1:2 ternary complexes that co-encapsulate two guests via charge-transfer stabilization [1], and coordination cages encapsulate guests in self-assembled metal-organic cavities, usually binding multiple guests [4]. Many existing hosts mechanistically fall outside the representational scope of CB7Mol.
We also run additional experiments to test the ability of CB7Mol to generalize to unseen hosts. We adopt 16 OA/TEMOA host-guest pairs from SAMPL6 [11] and 16 TrimerTrip (an acyclic cucurbituril) host-guest pairs from SAMPL7 [8] for evaluation, and use the same model checkpoint in CB[7]-related experiments. Results are summarized in the table below:
Despite belonging to a different host family, OA/TEMOA recognize guests through the same dominant driver as CB[7], which is the hydrophobic encapsulation of the guest. Therefore, CB7Mol can achieve competitive performance on SAMPL6. TrimerTrip, by contrast, is an open, flexible acyclic host, whose very different geometry alters the binding mechanism, and CB7Mol is outperformed by general-purpose foundation model like GET.