- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents a preference-conditioned, multi-objective generative flow network (GFlowNet) for redesigning antibody CDRH3 loops within fixed frameworks. The method fine-tunes a biological sequence model using up to 14 predictive rewards spanning structural compatibility, immunogenicity, novelty, and developability. It also introduces an autoregressive span-infilling variant of AMPLIFY-350M for scaffold-conditioned generation and conditional likelihood scoring. On 45 held-out antibody complexes, the approach generates approximately ten times more distinct acceptable candidates per design than ProteinMPNN and ESM-IF at a 50% sequence-identity threshold.
Critical strengths
-
GFlowNets have been widely applied to biomolecular design because they can sample candidates with probabilities proportional to externally specified rewards. In this study, the authors integrate GFlowNets with multi-objective optimization to construct the diverse reward function incorporating multiple criteria for antibody CDR-H3 design. Therefore, this research work can be regarded as a successful application of GFlowNets in this domain.
-
The authors progressively optimize a multi-objective GFlowNet through four stages to achieve the ultimate goal of CDR-H3 design. By incorporating multi-objective optimization into the GFlowNet framework, their approach demonstrates a strong foundation in mathematical theory and AI algorithms and provides valuable insights for future research.
-
Notably, at the experimental level, the proposed approach yields approximately ten times more distinct acceptable candidates per design than the inverse-folding methods ProteinMPNN and ESM-IF, using a 50% sequence-identity threshold.
Critical weaknesses
-
The framework overview in Figure 1 does not currently convey the algorithmic workflow clearly, particularly for readers who are not already familiar with GFlowNets. I suggest that the authors emphasize both the overall GFlowNet architecture and the 14 reward functions tailored to the CDR-H3 design task. Specifically, the figure could draw on the flow-network schematics presented in Bengio’s blog and prior related work, while highlighting how the adapted reward functions capture the biological objectives relevant to CDR-H3 design.
-
I recommend that the authors revise the experimental section. The current figure and table captions are somewhat lengthy, and the experiment section lacks ablation studies that would isolate the contributions of individual GFlowNet components, such as the policy model, reward function, and training objective.
-
In the Related Work section (Page 3, Line 120-121), according to my knowledge, the product of experts refers to the normalized product of the probabilities assigned by two models—specifically, the sum of the log-probabilities from ProGen2 and the Potts model followed by renormalization—rather than to ProGen2 alone. The authors should revise this description slightly to ensure that the distinction is clear and technically accurate
-
A persistent challenge in applying GFlowNets is training instability during flow matching. How do the authors weight the 14 reward functions, and how stable is the training process throughout this research study?
Questions for authors
I suggest that the authors expand the experimental evaluation to clarify which of the proposed model’s novel components contributes most to its final performance. Such analysis would provide stronger evidence for the advantages of the proposed method.
4 comments
Supplement with Preliminary Results Updated, including UMAPs in a Supplemental .zip
Please note our general comment above "Supplement with Preliminary Results Updated, including UMAPs in a Supplemental .zip"
We look forward to your feedback regarding our work, and would be happy to answer any final questions you might have. Thank you for your careful review and insightful feedback.
I thank the authors for their response. After carefully considering the responses, my overall assessment of this paper remains unchanged, and I therefore retain my original score.
Any specific concerns I failed to address?
Are there any specific concerns from your review that my revisions failed to address?
The updated version of our manuscript is available - all changes are marked in RED. Note that the majority of the new analysis is in the appendix currently, in it's own section "Preliminary Results"
Thank you for these concrete suggestions. We revised Figure 1 to show partial-sequence states, amino-acid actions, terminal rewards, the policy and the 14-reward preference mapping, and shortened captions while specifying what their bars represent. The related-work description now identifies the normalized product of ProGen2 and antibody-domain Potts probabilities.
Component contributions. Appendix H compares learned and fixed projection on identical rewards (Figure 24), novelty removal with projection refitting and original REINFORCE (Figure 25; Table 19), heated controls (Figure 26), and non-GFN reward selection (Table 16). Learned projection improves shared reward coverage but provides no clear shortlist quality/diversity advantage. On the selected 20 targets, the no-novelty arm retains substantial raw diversity and has higher mean fractions passing the common quality thresholds than D5, without a clear diversity or energy gain in the Rosetta-best 13 shortlists (Tables 18–19). Original REINFORCE has concentrated sampling; different exploration settings prevent attributing this solely to the optimizer. We did not ablate the AMPLIFY backbone, so these comparisons do not identify one component as the principal cause of final performance. Added main Figure 4 shows differences in raw sequence neighbourhoods; main Figure 5 shows varied predicted contact patterns among designs passing common quality thresholds. These findings suggest potentially functional variation, but practical usefulness requires experimental validation, hence our "promising" framing.
Weighting and stability. For normalized rewards r̂, positive row-stochastic projection A and sampled slot preferences w, the scalar reward is R=wᵀAr̂, with effective objective weights Aᵀw; the target sampling distribution is proportional to R⁸. We sample preferences over the reduced reward slots; the projection and sampled preferences jointly determine the weights on the fourteen original rewards. Figure 28 tracks how the probabilities assigned to a fixed set of sequences change during training. For each model, we selected 64 CDRH3 sequences from its final generated pool for each of 12 antibody frameworks, reusing these sequences under five fixed preference vectors. Figure 28 shows 26 saved main-trajectory checkpoints—13 per model—with stored normalized rewards and the final projection held fixed. Median centered trajectory-balance residual SD decreases from 1.477 to 0.850 for D4 and 1.475 to 0.764 for D5. This supports closer agreement between relative sequence probabilities and the final reward target on these fixed test cases. The bands describe variation across framework/preference combinations, not independent training runs. The online min–max normalizer and learned projection change the reward target during training before each is frozen. We did not separately ablate these safeguards, and the diagnostic does not establish global convergence or robustness across training seeds.
We will reply on the last day of the discussion period as further results become available, but appreciate that you might only have time to consider the results available today. Thank you for your suggestions, which have materially strengthened the precision of the claims made in the paper.
Should you have further suggestions around clarity of the experimental write up, we would be happy to include those clarifications in time for any camera ready version of the paper.