- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes D-PLBA, a two-stage framework for protein-ligand binding affinity prediction. A trajectory model pretrained on MISATO autoregressively predicts pocket and ligand conformations together with interaction energies. The frozen model then supplies multiple conformations to an affinity predictor with energy-conditioned aggregation. The paper reports improvements on PDBbind, CSAR-HiQ, and OpenBind, together with efficient trajectory inference. The application is well motivated, but the evaluation contains an unresolved metric inconsistency, and the evidence does not adequately establish the claimed contribution of physically meaningful dynamics. Overall I recommend rejection because the reliability of the comparative evaluation and the claimed contribution of physical dynamics are not adequately established. The SD inconsistency directly affects confidence in the benchmark reporting; the RMSF interpretation, incomplete ablation controls, and qualitative energy analysis leave the main scientific claims insufficiently supported. Addressing these concerns requires reconciliation of the evaluation and focused controlled validation.
Critical strengths
- Incorporating local pocket-ligand flexibility into affinity prediction is a relevant direction. Pretraining a reusable trajectory model and freezing it for downstream learning is a practical design.
- The reported affinity improvements span several datasets, and the manuscript includes both component ablations and a frame-count sensitivity study. These experiments provide useful initial evidence for incorporating multiple conformations and energy information.
Critical weaknesses
- The reported SD values are inconsistent with the stated metric under its standard interpretation Equation (11) defines SD using residuals after fitting a regression line. If the intercept and slope are fitted by least squares to the evaluated predictions, the identity line is an admissible fit, giving SD <= sqrt(n/(n - 1)) * RMSE. For the stated 285-complex PDBbind test set, SIGN's RMSE of 1.306 therefore implies SD <= 1.3083, whereas Table 1 reports 1.382. The same problem occurs for IGN (RMSE 1.372; maximum SD 1.3744; reported SD 1.417) and MBP (RMSE 1.231; maximum SD 1.2332; reported SD 1.244). These discrepancies exceed rounding error and would persist when averaging matched runs. If a different fitting protocol or evaluation set was used, it needs to be specified and reconciled with Equation (11). This inconsistency concerns the reliability and comparability of the central benchmark results. The authors should provide the metric implementation and fitting protocol and recheck the table using consistently evaluated predictions.
- Larger RMSF does not establish better trajectory prediction Table 2 labels RMSF with an upward arrow and ranks larger values as better, while Section 4.2 uses high RMSF and low clash scores to support physically meaningful flexibility. However, Equation (12) measures fluctuations around the predicted trajectory's own mean; it does not measure agreement with reference fluctuations. Larger RMSF can reflect realistic flexibility, excessive motion, or accumulated drift. Low clash scores do not distinguish these possibilities. Although reference-based RMSD is also reported, it does not justify treating RMSF as a quantity to maximize. The relevant evaluation is agreement with reference MD RMSF profiles under matched alignment, atom selection, and sampling conditions, including fluctuation-amplitude errors. An initial-structure persistence baseline would also show how much the reported coordinate accuracy improves over retaining the starting structure. Without these comparisons, the RMSF ranking and the interpretation of increasing RMSF during rollout are not convincing evidence of accurate flexibility modeling.
- The ablations do not adequately isolate the source of the gains Figure 6(a-c) compares SS, LM, DS, SS+LM, and DS+LM, and explicitly labels DS+LM as the authors' method. However, Section 3.2 and Figure 2 do not specify an LM branch or its integration. It is therefore unclear whether the headline results in Tables 1 and 4 correspond to DS or DS+LM, and what is held fixed across the comparisons. An LM comparison is reasonable, but this undocumented component obscures the attribution of improvements to the proposed dynamics module. Figure 6(d,e) already varies the number of conformations from 1 to 9. At the fixed 1-ns sampling interval, however, this simultaneously changes the number of input frames, the rollout duration, and accumulated prediction error. It does not separate the benefit of additional conformations from that of temporal information. The key controls should hold the LM features, trajectory pretraining, downstream architecture, and training protocol fixed while comparing repeated static inputs with predicted DS inputs. Varying the number of retained DS frames over a fixed generated horizon, and shuffling the order of paired conformation-energy frames, would further test the claimed temporal contribution. Table 4 supports the usefulness of the added components, but does not establish that their gains require faithful temporal dynamics.
- Figure 5 and the trajectory analysis do not substantiate the claimed physical dynamics Figure 5 plots predictions and MD references against separate vertical scales within each panel, without labeling the energy quantity or units on those axes. Visual overlap on independently scaled axes cannot establish agreement in energy magnitude or fluctuation amplitude. Even for the narrower claim of similar temporal trends, the manuscript should quantify the claimed association under an explicit temporal sampling and normalization protocol. Appendix C acknowledges differences between the AMBER and GROMACS pipelines, but does not report a numerical value for the cited RMSD*_IE statistic. The energy transformation is also unclear: Appendix B describes a log-transformed evaluation scale while defining only the linear transformation IE = -IE_AMBER/10, and Appendix C again refers to a linear transformation. A shared calibrated scale, or a specified common normalization with quantitative trend statistics, is needed to interpret this experiment. The manuscript does assign 1 ns to each autoregressive step. Nevertheless, assigning a physical lag does not establish that the learned transitions reproduce time-dependent molecular behavior. Structural snapshots, coordinate RMSD, clash scores, and qualitative energy curves do not demonstrate correct temporal correlations or transition behavior. Validation of a relevant time-dependent observable, such as pocket-ligand contact or energy autocorrelation at the stated lag, would directly address this claim. As presented, the evidence for physically meaningful dynamics remains insufficient for the interpretation on which the paper's central contribution rests.
Questions for authors
. How were the regression parameters in Equation (11) fitted, and how do the authors reconcile the IGN, SIGN, and MBP SD values with their RMSE values? Were all metrics computed on the same predictions and test examples? 2. How closely do predicted RMSF profiles and amplitudes match reference MD under the same alignment and sampling protocol? How does trajectory RMSD compare with an initial-structure persistence baseline? 3. Do Tables 1 and 4 use DS or DS+LM, and what LM and fusion mechanism are used? With that configuration fixed, do the gains persist against repeated-static inputs and shuffled temporal order while keeping each conformation paired with its energy, and when frame count is separated from rollout duration? 4. What quantities, units, and transformations do Figure 5's two axes represent? Please report the definition and value of RMSD*_IE, quantify temporal-trend agreement under an explicit sampling and normalization protocol, and provide evidence that the generated sequence reproduces a relevant time-dependent MD