- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes RAFA, a framework for the joint generation of antibody and nanobody sequences and structures conditioned on a given antigen. It employs Reward-Gradient Transport (RGT) to incorporate terminal coordinate-based reward gradients into the update of velocity fields—evaluated over sparsely sampled states—thereby improving the quality of the generated interfaces at a lower computational cost.
Critical strengths
The experiments cover structure prediction and design for two types of antibody formats, incorporating comprehensive mechanistic controls. Post-training RGT on VH–VL pairs yields performance gains that extend to VHH formats; furthermore, sequence refolding using Protenix-v2—a model distinct from the source of the reward labels—results in continued improvements in DockQ scores. Under identical experimental conditions, both RGT and full BPTT achieve an average DockQ score of 0.172, yet RGT reduces training time from 55 hours to 24 hours and peak VRAM usage from 72 GiB to 24 GiB (Table 9), demonstrating its practical efficiency.
Critical weaknesses
-
Empirical support for the incremental benefits of the proposed method remains insufficient. While Appendix F.4 discusses the shared structure and differences between RGT and DRTune, the closest "matched" DRTune baseline is presented only graphically in Figure 4, lacking precise numerical values and an uncertainty analysis of the paired differences. In Table 9A, the DockQ gains for linear time-weighting—relative to constant and quadratic weighting—are 0.008 and 0.003, respectively; furthermore, the inference-seed repetitions in Table 10 do not sufficiently demonstrate the robustness of these differences against the stochasticity inherent in the training process. Given that the "random" and "shuffled" controls in Table 8 also show some improvement, it is necessary to more accurately quantify the specific gains attributable to correct gradient directions and trajectory pairing. It is recommended that the authors provide paired confidence intervals for key baselines, conduct additional independent training runs, and clarify the number of training seeds used for the results in Table 9B.
-
The benefits relative to filtering at inference time remain unclear. The paper lacks a direct comparison against a "best-of-N" re-ranking approach, where the same reward model is used to select from outputs generated by the base model. It is recommended to report the quality—as well as the generation and scoring costs—for both RAFA and RGT using identical candidate budgets (e.g., and ). This would clarify how the post-training process improves the quality-cost trade-off. Even if a "best-of-8" selection from the base model performs comparably to a single-sample output from RGT, the significance of this result should be evaluated by accounting for the additional inference costs alongside the amortized training costs.
Questions for authors
- The reward relies primarily on interface geometric proxies and a specified epitope; therefore, its correlation with docking metrics should be clearly qualified in the conclusions. Independent refolding results serve as valuable supplementary evidence; please clarify whether the MSA, templates, random seeds, and candidate selection protocols used for refolding were consistent across all methods. It is recommended to report the direct sequence identity between the sequences generated by RAFA and RGT to help explain how sequence variations contribute to improvements in refolding; similar amino acid recovery (AAR) values alone are insufficient to address this.
2 Please provide the predictive performance of the fold-confidence surrogate on held-out calibration samples to demonstrate the validity of this reward component. Regarding the lower DockQ scores for DiffAb/MEAN in Table 14, please also provide information on the quality of the initial complexes or include an appropriate sanity check to distinguish the impact of the initial poses from that of the subsequent design steps.
2 comments
Dear Reviewer pDpT,
We would appreciate a brief update on whether our additional experiments and clarifications address your concerns, particularly the matched-budget comparisons, best-of-N evaluation, and surrogate validation. If any concerns remain, we would welcome the opportunity to clarify them before the discussion closes.
Thank you again for your time and consideration.
Best regards, The Authors
Dear Reviewer,
Thank you again for your valuable comments. As the discussion period is nearing its end, we would like to kindly ask whether our responses have adequately addressed your concerns. Please let us know if any further clarification is needed. If our responses have resolved your concerns, we would sincerely appreciate your consideration in updating your evaluations accordingly.