- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors point out that molecular dynamics (MD) simulations provide rich conformational information for protein–ligand binding affinity prediction, yet existing methods make limited use of it. Most approaches describe a complex using a single static conformation, which captures only a snapshot of an inherently dynamic binding process. Methods that do incorporate MD either treat sampled conformations as independent training instances (data augmentation) or compress trajectory-level dynamics into static graph edges, leaving fine-grained interaction dynamics underexploited. To address this, the authors propose DrugDyn, a unified framework that makes more effective use of MD simulations. It consists of two components. Geometry-Aware Spatiotemporal Attention (GASA) captures geometry-dependent protein–ligand interactions within each conformation and models how each atom’s interaction environment varies across conformations, followed by an adaptive aggregation that weights conformations by their importance. Multi-Cardinality Contrastive Learning (MCCL) treats subsets containing different numbers of conformations as different views of the same complex, aligning views from the same complex while separating those from different complexes, thereby yielding coherent and discriminative complex-level representations. DrugDyn is evaluated on five representative structure-based models used as backbones, and compared against the static baseline as well as two MD-based strategies: MD-based data augmentation (DA) and motion-derived edge augmentation (MDEA). On both the standard PDBbind core-set benchmarks and the cross-protein LBA splits, DrugDyn outperforms these alternatives across all backbones.
Critical strengths
- The experiments are extensive, covering five representative structure-based models (EGNN, GIGN, DTIGN, DeepRLI, and BA-Pred) as backbones, which supports the claim that the framework is backbone-agnostic.
- The evaluation uses a comprehensive set of metrics, covering both prediction error and the linear and ranking consistency between predicted and experimental binding affinities.
- Motivated by the observation that existing MD-based strategies map complexes with very different binding affinities to similar latent representations, the authors design MCCL, which treats conformational subsets of different sizes as views of the same complex, to make the representations of different complexes more distinguishable.
Critical weaknesses
- Conformation selection. The authors select 10 representative conformations from the 100 provided by MISATO, but the selection criterion is not described. Since the method relies on these conformations to represent the ensemble, the selection strategy may affect the results and should be specified.
- Inconsistency in the MCCL design. MCCL constructs each view by simply averaging conformation embeddings, and the view with k = 1 reduces to a single conformation. This seems to contradict the authors’ own motivation in Section 3.2 that “directly treating individual conformations as separate views may be suboptimal.”
- Limited ablation. The ablation study is conducted only on the v2016 core set with three of the five backbones. It does not cover LBA-30, which is the most informative benchmark for assessing cross-protein generalization.
Questions for authors
I have some questions about the data splits used in the experiments, as the paper does not describe them in detail.
- Overlap between the training set and the core sets. The paper states that models are trained on the PDBbind v2019 general set and evaluated on the v2013 and v2016 core sets. Since PDBbind versions are cumulative and the core set is a subset of the refined set, which is in turn a subset of the general set, the v2019 general set contains the complexes in both the v2013 and v2016 core sets. Could the authors clarify whether these core-set complexes were removed from the training data? In addition, does “general set” here refer to the full general set (including the refined set), or to the general set excluding the refined set as distributed in the PDBbind download?
- Training data for the LBA experiments. The LBA-30 and LBA-60 splits are derived from the PDBbind v2019 refined set, which is also contained in the v2019 general set. Could the authors clarify which data the models were trained on in the LBA experiments? Specifically, were the models trained on the training portion of each LBA split, or were the models trained on the v2019 general set reused for evaluation on the LBA test sets? I would also appreciate it if the authors could release the code or the exact lists of training, validation, and test complexes, which would make these settings easier to verify.
5 comments
Response to Reviewer AzLM (Part 2)
In response to Weakness 3
To further validate the effectiveness of our proposed components under cross-protein generalization, we extended our ablation study to the LBA-30 benchmark using GIGN and DTIGN as backbones. The additional results are summarized below.
| Backbone | Method | RMSE↓ | MAE↓ | ↑ | ↑ | ↑ |
|---|---|---|---|---|---|---|
| EGNN | Baseline | 2.084 | 1.622 | 0.440 | 0.446 | 0.307 |
| GASA | 1.753 | 1.396 | 0.454 | 0.453 | 0.312 | |
| SCCL | 1.836 | 1.454 | 0.414 | 0.422 | 0.289 | |
| MCCL | 1.779 | 1.402 | 0.449 | 0.454 | 0.313 | |
| Full | 1.735 | 1.392 | 0.458 | 0.462 | 0.318 | |
| GIGN | Baseline | 1.997 | 1.617 | 0.486 | 0.466 | 0.319 |
| GASA | 1.621 | 1.279 | 0.521 | 0.484 | 0.339 | |
| SCCL | 1.813 | 1.400 | 0.436 | 0.437 | 0.306 | |
| MCCL | 1.664 | 1.356 | 0.464 | 0.455 | 0.313 | |
| Full | 1.498 | 1.198 | 0.526 | 0.500 | 0.350 | |
| DTIGN | Baseline | 1.967 | 1.581 | 0.412 | 0.403 | 0.276 |
| GASA | 1.829 | 1.436 | 0.469 | 0.470 | 0.328 | |
| SCCL | 1.900 | 1.556 | 0.434 | 0.414 | 0.283 | |
| MCCL | 1.675 | 1.335 | 0.459 | 0.448 | 0.308 | |
| Full | 1.566 | 1.281 | 0.504 | 0.480 | 0.331 |
As shown above, both GASA and MCCL contribute to improving prediction performance, while their combination consistently achieves the best results across all five metrics on both backbones. These findings further demonstrate the complementary benefits of the two components under cross-protein generalization.
In response to Question 1
We clarify that the PDBbind v2019 general set refers to the full general set, including the refined set. In addition, we explicitly excluded all complexes belonging to the PDBbind v2013 and v2016 core sets from the training data to prevent direct overlap between the training and test sets. Therefore, neither core set contains complexes used during training.
In response to Question 2
We clarify that for the LBA-30 and LBA-60 experiments, all models were trained independently on the training portion of their respective splits, rather than reusing models trained on the PDBbind v2019 general set. Specifically, following the established ATOM3D protocol [1], also adopted by CheapNet [2], we use the PDBbind v2019 refined set with protein sequence identity thresholds of 30% and 60% to construct the LBA-30 and LBA-60 benchmarks, respectively. For each benchmark, we use its corresponding training set for model training, validation set for model selection, and held-out test set for evaluation.
The exact training, validation, and test split indices are publicly available through the official ATOM3D dataset release (https://zenodo.org/records/4914718), including separate split files for LBA-30 and LBA-60. We strictly follow these official splits in our experiments.
[1] Townshend, Raphael JL, et al. "Atom3d: Tasks on molecules in three dimensions." arXiv preprint arXiv:2012.04035 (2020).
[2] Lim, Hyukjun, Sun Kim, and Sangseon Lee. "Cheapnet: Cross-attention on hierarchical representations for efficient protein-ligand binding affinity prediction." International Conference on Learning Representations. Vol. 2025. 2025.
Thank you to the authors for the detailed and constructive rebuttal. I appreciate the additional experiments on conformation sampling strategies and the extended ablation study on LBA-30, which address two of my major concerns.
However, I noticed that the results for GIGN and DTIGN under the "Fixed Interval 10" sampling strategy are exactly identical across all five metrics (RMSE: 1.451, MAE: 1.125, R: 0.747, ρ: 0.744, τ: 0.554). Given that these are two different backbone models, this coincidence seems unusual. Could the authors please verify whether these results are correct or whether there might be a reporting error in the table?
The clarification regarding dataset splits is also helpful and largely resolves my concerns about potential training–test overlap.
Overall, the rebuttal has addressed most of my concerns and improved my assessment of the paper. I am inclined to reconsider my initial rating, pending clarification of the identical results noted above.
Response to Reviewer AzLM (Part 1)
We sincerely thank the reviewer for the thoughtful and insightful feedback. We have carefully considered the concerns raised and provide detailed point-by-point responses below.
In response to Weakness 1
Following MDDTA [1], we adopt a clustering-based sampling strategy to select 10 representative conformations from the 100 MD trajectory frames provided by MISATO. Specifically, the 100 frames are clustered based on their three-dimensional atomic coordinates into 10 clusters, and one representative conformation is selected from each cluster. This strategy aims to capture diverse structural states rather than selecting frames randomly or at fixed temporal intervals.
To further evaluate the impact of different conformation selection strategies on DrugDyn's performance, we conducted additional experiments on the PDBbind v2016 core set using GIGN and DTIGN as backbones. We evaluated random frame sampling (RF), contiguous temporal windows (CTW), and uniform temporal sampling with a fixed interval of 10 frames. We maintained 10 frames, consistent with our default setting. The results are summarized below.
As shown above, DrugDyn consistently outperforms the corresponding baselines under all evaluated sampling strategies, while the clustering-based selection achieves the best performance on both backbones, suggesting that capturing representative and diverse structural states is beneficial for modeling protein–ligand interactions. We will clarify the conformation selection procedure in the revised manuscript and incorporate these additional experimental results into the manuscript or supplementary materials, as appropriate.
[1] Zhao, Long, et al. "MDDTA: A Drug Target Binding Affinity Prediction Method Based on Molecular Dynamics Simulation Data Enhancement." IEEE Journal of Biomedical and Health Informatics (2026).
In response to Weakness 2
We would like to clarify that the averaging operation in MCCL serves to construct multi-conformation views and does not need to model cross-conformation interactions. This is because the conformation embeddings have already undergone spatiotemporal modeling through GASA, which explicitly captures atom-level dependencies across conformations. MCCL therefore only needs to average these representations over different conformational subsets to construct views of varying cardinalities.
Furthermore, our motivation is that relying solely on individual conformations as contrastive views may be suboptimal, rather than excluding single-conformation views entirely. We recognize that our original statement, "directly treating individual conformations as separate views may be suboptimal," could be ambiguous. To improve clarity, we will revise it to "Relying solely on individual conformations as contrastive views may be suboptimal." In addition to k=1, MCCL incorporates k=3,5,7 to capture different observations of the underlying conformational ensemble, thereby encouraging consistent complex-level representations across different view cardinalities while reducing the influence of individual conformational fluctuations and thermal noise.