- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces Reward-tilted Diverse Discrete Diffusion (RD3), combining masked discrete diffusion, reward-guided fine-tuning, and particle guidance for biological sequence optimization under limited experimental budgets. The method is evaluated on nine benchmarks spanning DNA, RNA, peptide, and protein design.
Critical strengths
- The proposed benchmark is comprehensive, including diverse biological sequence design tasks and MANY NON-RL baselines.
- The proposed method achieve good performance, particularly in maximum fitness, and provides additional evaluations of diversity and novelty.
Critical weaknesses
- The method mainly combines existing techniques/methods, including masked diffusion, RTB, and particle guidance. The novelty of method is limited. This is my largest concern.
- The evaluation for budget-efficiency is limited. Although limited experimental budgets are a central motivation, the evaluation primarily emphasizes maximum fitness, which cannot fully reflect the motivation.
- The fitness evaluation is unclear. The biological meaning of fitness scores vary largely across DNA, RNA, and protein tasks.
- The ablation metrics are not fully aligned. The main ablation figures emphasize mean fitness, diversity, and novelty, but the main benchmark results (Table 1) focus on maximum fitness.
- More baselines and related works, especially for which may be very COMPETATIVE ACROSS THESE BENCHMARKS should be mentioned. For example, [1-3]. More importantly, there are OVERLAPs between this method and the unmentioned related works. At the very least, the authors need to mention them even if not compare them. Otherwise, the scientific claim is soundless.
[1] Tang, S., Zhang, Y., & Chatterjee, P. (2025). Peptune: De novo generation of therapeutic peptides with multi-objective-guided discrete diffusion. ArXiv, arXiv-2412. [2] Cao, H., Shi, H., Wang, C., Pan, S., & Heng, P. A. (2026). GLID e: A gradient-free lightweight fine-tune approach for discrete biological sequence design. Advances in Neural Information Processing Systems, 38, 139875-139898. [3] Tang, S., Zhu, Y., Tao, M., & Chatterjee, P. (2025). Tr2-d2: Tree search guided trajectory-aware fine-tuning for discrete diffusion. ArXiv, arXiv-2509.
Questions for authors
- How is the quality of each generated candidate evaluated, and how do the predicted reward correlate with oracle fitness?
- How are the fitness functions constructed for different biological tasks? How to ensure independent evaluation and avoid circular validation given different kinds of fitness?
- Why is maximum fitness the primary metric? Would #proportion of candidates passing a fitness threshold better reflect practical experimental outcomes since we also expect more positive candidates during experiments.
- What is the practical benefit of higher novelty or diversity?
- What is the essential innovation beyond combining existing methods or modules?
5 comments
[Q1: Correlation Between Acquisition Scores and Oracle Fitness]
Thank you for requesting this analysis. Candidate quality is estimated using an upper-confidence-bound (UCB) acquisition score, based on the proxy ensemble's predicted mean fitness and uncertainty.
We evaluated the Spearman rank correlation between acquisition scores and oracle fitness for all generated candidates (Full-pool) and the final batches selected for oracle evaluation (Selected-batch). Full-pool Spearman correlations ranged from 0.622 to 0.969, supporting the usefulness of acquisition scores for ranking the candidate pool. Correlations remained positive but were lower within selected batches (0.347–0.598), where the restricted acquisition-score range makes fine-grained ranking more challenging. We report both Pearson and Spearman correlations, along with the evaluation protocol and round-wise results, in Appendix [E.6].
| Task | Full-pool Spearman | Selected-batch Spearman |
|---|---|---|
| AAV | ||
| RNA-A | ||
| RNA-B | ||
| RNA-C | ||
| TF-Bind-8 |
[Q2: Candidate Evaluation Using Proxy-Based Acquisition Scores]
We apologize that the distinction between the learned proxy and the benchmark oracle was insufficiently clear. The proxy is updated using the measurements available at each round and provides acquisition scores for generation and query selection. Reported fitness is obtained from a separate, fixed benchmark oracle, rather than from the proxy used to guide the search. The benchmark oracle is accessible only during the final evaluation stage of each round and is not available during candidate generation or selection. Instead, RD3 relies on a separately trained proxy to estimate candidate fitness and guide the search, using oracle feedback only to update the proxy for subsequent rounds.
[Q3: Proportion of candidates exceeding a fitness threshold]
| Method | AAV hit rate | RNA-C hit rate | TF-Bind-8 hit rate |
|---|---|---|---|
| RD3 | |||
| GFN-AL- CS | |||
| AdaLead |
We thank the reviewer for highlighting the importance of obtaining multiple high-fitness candidates. Maximum fitness measures the best sequence discovered within a fixed oracle budget; we complement it with the hit rate, defined as the fraction of newly queried candidates exceeding a threshold. We set the threshold to , where is the best fitness in the initial dataset and is the highest fitness observed across the compared methods over the runs and evaluation horizon. RD3 achieved higher mean hit rates than both baselines on the three tasks shown above. Full threshold definitions and results are provided in Appendix [D.3] and Appendix [E.3], respectively.
[Q4: Practical value of novelty and diversity]
In biological sequence design, discovering new functional sequences beyond known datasets is important because existing sequences may already have been investigated, developed, or patented. While novelty helps identify promising sequences beyond the starting collection, diversity provides alternative candidates for validation. As discussed by Jain et al. (2022), early screening is imperfect, so highly similar candidates may fail at later stages. A diverse set of high-fitness candidates may reduce this risk and offer more opportunities to satisfy additional requirements not captured by the optimization objective.
Thank you very much for your rebuttal. For your rebuttal:
-
Thank you for your clarification. From the ML perspective, I still can not agree the novelty of this method towards this task. It may be a good adaption, but it is not a novel algorithm. Also, the motivation and the "novelty" are mis-aligned.
-
The response looks good.
-
I did see Appendix D1 and E(6? I didn't find E.6 actually, please check). I agree they are clear, and from open-source database. But two questions: 1) there should be different oracle/reward design towards different "fitness"; and 2) The exact processing may not follow biological rules. For example, you have no clear definition to AMP activity. I appreciate the workload you have done, but your results and data may not be precise and realiable.
-
I didn't see E.8.
-
Thank you. It addressed my concern.
Overall, I think this work still need a very major revision. I will keep my score and confidence.
Dear Reviewer f8Dt,
We appreciate your detailed review and constructive criticism. Your comments have helped us clarify the methodological novelty of RD3, the roles of proxy-based rewards and benchmark oracles, and the practical motivation for diverse exploration. We also provide additional experimental analyses to address your concerns, as detailed below.
[W1, Q5: Methodological novelty and overlap with prior methods]
We thank the reviewer for this comment. As discussed in our response to Reviewer YJaZ W5, the key methodological contribution of RD3 is KL-calibrated categorical particle guidance for masked discrete diffusion, integrated with local reconstruction and reward-aligned generation for budget-constrained exploration. Please refer to that response for a detailed discussion of our novelty and its distinction from prior methods.
[W2: Oracle-query efficiency and budget considerations]
We thank the reviewer for raising the question of oracle-query efficiency. RD3 achieved the highest normalized AUC on seven of nine tasks (Table 1). On AAV, RD3 achieved a mean maximum fitness of 0.7460 with 200 oracle queries, exceeding the best baseline result with 1,280 queries (AdaLead, 0.7160; Table 2). Please see our responses to Reviewer YJaZ W2 for optimization progress across nine tasks and Reviewer YJaZ W3 for performance under reduced query budgets on AAV.
Table 1. Normalized AUC across nine tasks. Bold indicates the highest reported value in each column.
Table 2. Maximum fitness on AAV over ten rounds. (B) is the number of oracle queries per round.
[W3: Biological meaning of fitness]
TF-Bind-8 uses an experimentally measured binding landscape; RNA tasks use ViennaRNA-based energy scores; AAV uses a measurement-derived additive model; and AMP, GFP, Pab1, and E4B use fixed pretrained predictors. We have clarified the oracle definitions and sources in Appendix [D.1] and Appendix [E.6], respectively.
[W4: Maximum versus mean fitness in ablation studies]
We use maximum fitness as the primary evaluation metric, as our main objective is to discover the best-performing sequence under a limited oracle budget. In contrast, mean fitness in our ablation studies evaluates the overall quality of generated candidates, allowing us to assess whether improvements in diversity come at the cost of fitness. We also provide Maximum-fitness results in Appendix [E.8].
[W5: Related work on PepTune, GLID²E, and TR2-D2]
We thank the reviewer for drawing our attention to these important and closely related studies. Monte Carlo Tree Guidance from PepTune, reward-guided fine-tuning of GLID²E, and integration of tree search with trajectory-aware learning from TR2-D2 offer valuable approaches to guided biological sequence design. While these works also investigate guided or reward-based biological sequence generation, RD3 specifically addresses diversity-aware exploration across iterative oracle-query rounds under a limited experimental budget. We have expanded the related-work discussion to better recognize all three studies.