- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces Proteína-Reforza, which adapts Advantage Weighted Matching to post-train a joint sequence–structure protein binder generator. It explores structural, physical, and experimentally learned rewards for general and target-specific design, including cyclic peptides. Computational benchmarks show substantial improvements in successful binder generation. PD-L1 binding experiments and peptide display screens provide additional support, though the experimental evidence is narrower than the computational evaluation.
Critical strengths
-
The improvement on the main protein-binder benchmark is substantial. Under the same sampling budget, successful designs increase from 22.05 to 91.14 per target, and structurally distinct successes from 14.18 to 61.82. Gains also transfer to alternative structure predictors, making the result more convincing than an improvement measured only by the training reward.
-
The paper provides experimental evidence beyond computational scores. The PD-L1 study identifies seven binding-positive designs from the adapted RL model versus none from the base model, with the best showing an apparent affinity of 64.7 nM. Although limited to a target-adapted setting, this is meaningful evidence that the approach can improve practical binder discovery.
Critical weaknesses
The main protein-binder benchmark lacks a filtering-based supervised fine-tuning baseline under a matched reward-evaluation budget. Consequently, the results do not establish how much of the improvement comes from AWM rather than learning from reward-selected samples. Comparing AWM against iterative generation–scoring–filtering–SFT, with matched initialization, target distribution, and reward-evaluation budget, would help isolate the benefit of the proposed optimization approach.
Questions for authors
How does AWM compare with iterative generation–scoring–filtering–SFT on the main protein-binder benchmark, using the same initialization, target distribution, and reward-evaluation budget? This comparison would clarify whether AWM offers a meaningful advantage over simply training on reward-selected samples.
Thank you for recognizing the benchmark gains, their transfer across structure predictors, and the value of the PD-L1 results. Our additional experiments are in Section K. To show the generality of our approach, we also include results on RFD4-Proteina (§K.4) that show RL can further improve a new generator with a different architecture.
We carried out this suggested comparison and added the results in §K.2 and Figure 40, using the same Complexa initialization, target distribution, and reward-evaluation budget for iterative filtered SFT and RL. Reforza produces about 3.5× as many structurally unique successes as the stronger SFT round.
Filtered SFT improves over the base model, but another round slightly increases total successes while reducing structural diversity. This suggests that repeated training on a small, positive-only dataset concentrates generation around the retained examples rather than discovering new successful folds.
Unlike filtered SFT, which only imitates accepted designs and discards the training signal from rejected ones, AWM uses relative rewards to reinforce higher-reward designs and suppress lower-reward designs, with fresh on-policy samples throughout training. This helps explain why RL finds a broader range of successful structures.
We hope the matched-budget filtered-SFT comparison addresses your main concern and clarifies the benefit of AWM beyond learning from reward-selected samples. If you feel that this concern has been addressed, we would be grateful if you would kindly consider raising your score in light of the new evidence.