- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
REPA is a strategy for pocket conditional 3D generative models that allow to align the intermediate features of the 3D generative model (like FlowR) with a pre-trained MLIP model. The method require additional training cost with no additional inference cost overhead, reaching higher posebuster validity, better strains and interaction recovery on CrossDocked2020 and SPINDR.
Critical strengths
-
The physics aware supervision is well defined in the paper. Additionally, results seems solid for two different architectures two architectures (DrugFlow and FlowR) and two datasets (CrossDocked2020 and SPINDR).
-
The ablations provide results on different setup, ie encoder type, layers in the architecture and loss weights. Even though some relevant details like training cost overhead (ie running uma frozen) or discussions of MLIP size tradeoff seems to be missing.
-
In tables 1-5, the paper provide insights on several metrics tradeoff with direct comparison to the native ligand.
Critical weaknesses
-
The improvements seem not statistically significant and consistent in table 1 and 2 (ie see Vina and/or Strains). For instance, on FlowR strains are going from 92.4 -> 101.1 and doesn't seem to be clearly explained in the paper.
-
Since MLIP are known to yield DFT performances, metrics based on MMFF94s strain and Vina are both known to be less reliable proxies. The results could benefit from higher quality evaluation metrics like DFT single-points and FEP on very few samples.
-
Now results are mostly reported per-metric fixing the training budget for FlowR. It would be interesting to see the reported tradeoffs every K epochs during the training.
Questions for authors
-
Figure 1 in the caption miss: (1) what pretrained model was used and (1) how many molecules were generated. Moreover, it is not referenced in the introduction but it is in the results. It's not clear why is being placed in the front page.
-
The caption in tables 1 to 5 seem too synthetic. I would shortly add more explicit details, like how many molecules were sampled and for how many epoch both baseline and baseline+REPA were tuned. Additionally, I would add in the caption the number of denoising steps (NFE) for inference.
-
Why figure 6 in the appendix shows just the training curves for DrugFlow and not for FlowR?
-
It is unclear why FlowR's strain increase with REPA while DrugFlow's decreases.
-
It is unclear why the features of the pocket wouldn't benefit from this alignment. This is something the authors should better clarify in the paper.
-
Can you provide more details in the paper on how the model is sensitive to different protonation schemes?
-
Reporting xTB single-point energies on a subset would confirm that MMFF94s strain reflect a true improvement.
6 comments
Response to Reviewer G5tM - part 2/4
Framing and the FLOWR strain question (W1, Q4)
W1: The improvements seem not statistically significant and consistent in table 1 and 2 (ie see Vina and/or Strains). For instance, on FlowR strains are going from 92.4 → 101.1 and doesn't seem to be clearly explained in the paper.
Q4: It is unclear why FlowR's strain increase with REPA while DrugFlow's decreases.
Thank you for pointing this out. Indeed, we do not have a definitive mechanistic explanation for the increased strain in molecules generated by FLOWR when trained with REPA. Empirically, however, we observe that compared to DrugFlow, even baseline FLOWR produces bond lengths with high variance—introducing stretched and compressed bonds that drive up the raw strain of generated molecules (Table 10). We hypothesize that this difference between generators stems from their architectures: DrugFlow is a heterogeneous GNN that explicitly models bond features, whereas FLOWR operates globally via an attention mechanism.
To investigate further, we added xTB and MACE evaluations that separately assess ligand deformation (strain) and ligand–pocket interaction energies:
Table E. Median energy components in kcal/mol (lower is better). Deformation is measured relative to a low-energy unbound conformer of the same ligand; "fixed" denotes values after RDKit bond/angle repair. Net fixed is the sum of repaired deformation and ligand–pocket interaction energies, computed for each candidate before taking the median. The component medians therefore need not sum to the median net energy. Results use a common set of pockets with valid calculations across all compared settings.
| Model | Evaluator | Strain generated | Strain fixed | Interaction fixed | Net fixed |
|---|---|---|---|---|---|
| DrugFlow | xTB | 33.4 | 30.0 | −25.2 | 5.7 |
| + REPA | xTB | 30.8 | 23.6 | −23.6 | 3.4 |
| FLOWR | xTB | 42.0 | 22.4 | −23.7 | −1.4 |
| + REPA | xTB | 53.1 | 23.7 | −25.9 | −0.5 |
| DrugFlow | MACE | 48.5 | 40.9 | −113.8 | −64.5 |
| + REPA | MACE | 42.7 | 37.2 | −121.1 | −70.8 |
| FLOWR | MACE | 55.4 | 31.6 | −93.8 | −51.4 |
| + REPA | MACE | 71.1 | 35.3 | −98.3 | −64.1 |
Both methods reproduce FLOWR's higher raw deformation with REPA, but local repairs involving approximately 0.05 Å heavy-atom movement substantially reduce the excess—from 11.1 to 1.3 kcal/mol under xTB. This suggests that much of the additional strain reflects small local geometric distortions. After repair, FLOWR's interaction energies improve under both methods, while its median net energy improves under MACE but not xTB. For DrugFlow, REPA lowers repaired xTB deformation (p=0.014) and repaired MACE net energy (p=0.024). We will clarify these architecture-dependent effects and the unresolved mechanism in the revised manuscript.
Response to Reviewer G5tM - part 3/4
FLOWR training curves and clarifications (W3, Q3; Q1, Q2)
W3: Now results are mostly reported per-metric fixing the training budget for FlowR. It would be interesting to see the reported tradeoffs every K epochs during the training.
Q3: Why figure 6 in the appendix shows just the training curves for DrugFlow and not for FlowR?
We agree that FLOWR's training dynamics should also be reported. We now provide checkpoint results (Table J), evaluated on 68 pockets (SPINDR validation set) with 10 samples per pocket across three seeds. REPA yields higher PoseBusters validity and lower strain at early checkpoints. By epoch 300, it retains higher PoseBusters validity (0.874 versus 0.855), but has higher median strain (60 versus 53 kcal/mol), consistent with the trade-off observed in the final test-set results in Table 2. We will include these curves in the revised appendix. Evaluating intermediate checkpoints on the full test set would require additional sampling beyond our rebuttal compute budget; Vina scores were not recorded during training.
Table J. Validation performance of FLOWR and FLOWR + REPA at selected training epochs. Results are averaged over three seeds, with 10 molecules generated for each of 68 validation pockets per seed. Higher PoseBusters validity and lower median strain (kcal/mol) are better.
| epoch | PoseBusters FLOWR | PoseBusters FLOWR+REPA | median strain FLOWR | median strain FLOWR+REPA |
|---|---|---|---|---|
| 20 | 0.237 | 0.470 | 697 | 246 |
| 60 | 0.749 | 0.803 | 107 | 92 |
| 100 | 0.819 | 0.837 | 76 | 72 |
| 200 | 0.858 | 0.863 | 58 | 64 |
| 300 | 0.855 | 0.874 | 53 | 60 |
Clarifications
Q1: Figure 1 in the caption miss: (1) what pretrained model was used and (1) how many molecules were generated. Moreover, it is not referenced in the introduction but it is in the results. It's not clear why is being placed in the front page.
We agree that this training comparison fits better with the experimental results. We will move Figure 1 to Section 5.1 and expand its caption to identify the pretrained UMA-S-1p1 teacher, the number of generated molecules, and the aggregation across seeds:
"Figure 1. Representation alignment improves PoseBusters validity and reduces strain for DrugFlowEMA. Training curves compare DrugFlowEMA with and without representation alignment to the frozen pretrained UMA-S teacher. At each checkpoint, each model generates 100 molecules for each of 100 CrossDocked2020 test pockets (10,000 molecules per seed). Lines show means and shading indicates ±1 standard deviation across three seeds. Higher PoseBusters validity and lower median MMFF94s strain are better."
Q2: The caption in tables 1 to 5 seem too synthetic. I would shortly add more explicit details, like how many molecules were sampled and for how many epoch both baseline and baseline+REPA were tuned. Additionally, I would add in the caption the number of denoising steps (NFE) for inference.
Thank you for this suggestion. We will expand the captions of Tables 1–5 to specify the number of test pockets, generated molecules, seeds, training epochs, and denoising steps. For our main comparisons, we generate 100 molecules per pocket per seed, using 100 CrossDocked2020 pockets or 222 SPINDR pockets, and average results across three seeds. Within each architecture, the baseline and REPA variant use the same training and sampling schedules: 600 epochs and 500 denoising steps (NFE) for DrugFlow, and 300 epochs and 100 denoising steps (NFE) for FLOWR. External baselines in Table 1 use released checkpoints and their default sampling settings, which we will distinguish explicitly.
Response to Reviewer G5tM - part 1/4
We appreciate the thoughtful comments of the reviewer. We address each of them below and support our answers by new experiments. Our response is split into four parts: (1) physics evaluation, (2) the FLOWR strain question, (3) FLOWR training curves and clarifications, (4) pocket alignment and protonation schemes.
Physics evaluation (W2, Q7)
We thank the reviewer for suggesting additional energy evaluations. Extending our evaluation with higher-fidelity potentials moves beyond empirical proxies like Vina and MMFF94s, providing a more rigorous assessment of ligand strain and protein–ligand interaction energies.
For each model and pocket, we selected the PoseBusters-valid molecule with the best as generated Vina score. We then evaluated each selected candidate in three states: as generated, after RDKit bond/angle repair, and after in-pocket minimization with the protein held fixed using:
Net energy is the sum of ligand–pocket interaction energy and ligand deformation energy relative to a low-energy unbound reference conformer of the same ligand. Table D reports the number of SPINDR targets, out of 222, whose selected candidate has a net energy below the median for native ligands evaluated with the same energy method. To test whether these gains require large pose changes, the last two columns additionally require a heavy-atom RMSD ≤0.5 Å.
Table D: Number of SPINDR targets (out of 222) whose selected candidate passes the net-energy criterion. Candidates must fall below the native-ligand median: −16.94 kcal/mol for xTB or −97.45 kcal/mol for MACE. The last two columns additionally require a heavy-atom RMSD ≤0.5 Å from the generated pose. Missing or invalid results count as unsuccessful; higher is better.
REPA increases the number of targets passing the criterion for DrugFlow across all settings, and for FLOWR after bond/angle repair and after in-pocket minimization. In the updated manuscript, we will include plots showing the number of successful candidates across all net-energy thresholds, not just the native-ligand median.
Enforcing pose preservation (last two columns of Table D) amplifies REPA's advantage under MACE, yielding statistically significant gains across both backbones (paired McNemar p=0.029 for DrugFlow; p=0.0004 for FLOWR) without requiring large conformational shifts; under xTB, DrugFlow is unchanged (p=1.00) and FLOWR increases modestly from 88 to 95 (p=0.470).
Large-scale DFT calculations were not feasible within the rebuttal period. We therefore performed two targeted case studies, one for FLOWR and one for DrugFlow, comparing a pair of baseline and REPA candidates with the same charge. We selected pairs where REPA showed a net-energy advantage after bond/angle repair. Using ωB97M-D3BJ/def2-SVP with C-PCM water on the full prepared, capped pockets, REPA retains its advantage in both cases: net energy −10.1 vs. −24.2 kcal/mol for FLOWR (baseline vs. REPA) and −32.7 vs −45.6 kcal/mol for DrugFlow (baseline vs. REPA). We will include the full protocol and example candidates in the updated manuscript.
Together, these results show that REPA improves candidate yield after structural refinement under xTB, MACE and, in these examples, DFT, extending the evidence beyond MMFF/Vina. We have not performed FEP; further binding free-energy calculations and experimental measurements would help assess whether these energetic improvements translate into higher binding affinity.