- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces an inexpensive selectivity reward for conditional diffusion generators. For the same candidate and shared corruption, SCORED subtracts the target-condition denoising error from a SoftMin over competitor-condition errors. This reward is used in an online RL pipeline initialized by reward-weighted regression, whose offline binding labels are mean-centered separately for each molecule. The main application is generation of organic structure-directing agents for six zeolite frameworks excluded from SFT, RWR, and RL training. Under the stated frozen-pose force-field evaluator, the complete pipeline obtains a mean competition score of 5.026 ± 0.334 kJ/mol Si over three runs, compared with 6.340 ± 0.031 without competitor contrast and 6.503 ± 0.110 without the denoising reward. Additional experiments study drug-design backbones and MOF generation, with mixed transfer results.
Critical strengths
-
The central target-versus-competitor contribution is tested directly. Table 2 and Table A.2 keep the architecture, RWR initialization, molecular-quality channels, and generation settings fixed while replacing the complete margin with target-only denoising feedback or removing denoising feedback. The resulting competition scores, 5.026 versus 6.340 and 6.503, support a contribution from the contrast itself. Full SCORED is better on all three run-level means according to Appendix C.3. Removing RWR or freezing the scorer increases the score to 8.157 and 7.149, respectively. These controls make the main evidence more convincing than the comparison with OSDA Agent alone. I also appreciate that improved selectivity is evaluated after generation by a force-field protocol rather than simply by reporting the optimized denoising reward.
-
The reward is simple, usable, and accompanied by unusually careful qualifications. Shared corruption makes the target/competitor comparison paired, and the log-odds identity in Appendix D explains precisely what the SoftMin margin measures. The paper explicitly avoids treating denoising error as physical energy or a calibrated likelihood. Table A.8 demonstrates a substantial reward-path saving, while Appendix F.5 distinguishes the timed six-condition, four-timestep configuration from the main four-condition, ten-timestep configuration. The authors also disclose the modest alignment correlations, the IPDiff non-improvement, and the absence of experimental crystallization evidence. These qualifications make the useful engineering contribution easier to assess.
Critical weaknesses
-
The primary physical endpoint remains conditional on substantial, method-dependent filtering. Equation (A.3) excludes unavailable competitor energies, and Appendix C.5 requires successful evaluation of the target and at least one competitor. Table A.3 reports joint evaluation for 38.3% of generated outputs for Full SCORED, 37.5% without the denoising reward, and 15.6% without competitor contrast. Its caption states that these counts come from runs different from those used in the main result tables. Figure A.1 is a useful partial response: Full SCORED actually has slightly greater mean competitor coverage than OSDA Agent, so reduced coverage is not an adequate explanation of that comparison. Nevertheless, aggregate coverage does not establish the robustness of score differences within comparable coverage strata or across the three scored runs. A complete-panel analysis and per-run yields would clarify how much of the gain represents better generated candidates versus a difference in which candidates receive a score. This matters because the conditional mean competition score is not an end-to-end success rate, and no crystallization outcome is measured.
-
Transfer beyond zeolites does not yet isolate the same selectivity mechanism with comparable rigor. Table A.11 provides a useful pocket-level paired bootstrap for TargetDiff, but the gain is small, +0.21 kcal/mol with a 95% interval of [0.01, 0.40], and the comparison removes the denoising reward rather than replacing it with target-only scoring. Target affinity also improves by 0.24 kcal/mol, leaving open whether competitor contrast supplies an additional benefit in this domain. Table A.13 reports an IPDiff change of −0.02 and an AliDiff change of +0.16 without comparable repeated-training uncertainty. The MOF experiment uses 80 outputs per arm and a surrogate-predicted absolute capacity endpoint. Appendix H.4 does not specify the target condition and competitor conditions used to construct its SCORED margin. These limitations are consistent with the authors' cautious descriptive framing, but they prevent the secondary experiments from strongly establishing general transfer of the target-relative mechanism.
Questions for authors
- Clarification of evaluation population. Can you report generation-to-evaluation counts for the actual three runs in Table A.2, and the main score comparisons restricted to candidates with all five competitors evaluated or stratified by competitor count? Does the improvement persist when conditional scores and physical-evaluation yield are reported together?
- Clarification of cross-domain specificity. For TargetDiff, does SCORED improve the selectivity gap over a matched target-only denoising reward, and how variable is the effect across independent RL runs? This would distinguish a contrast-specific effect from improved target affinity.
- Clarification of MOF implementation. What are the target and competitor conditions, scoring timesteps, temperature, and condition-sampling rule in Table A.14? How are failed CIF constructions handled in the reported capacity means?
6 comments
W1 & Q1: Clarification of Evaluation Population: Full SCORED Leads in Physical-Validation Yield and Competition Score Stratified by Competitor Count
Follow your valuable suggestion, we replaced the earlier separate-run counts in Table A.3 with the actual three runs behind Table 2/A.2 (3000 generations each) and provide stratified comparison, and confirm that the improvement persists when conditional scores and physical-evaluation yield are reported together:
- Per-run funnel for Full SCORED: each run generates candidates per framework across frameworks, so raw outputs, and we provide the comparison of the percentage of molecules with valid competition score, Joint/Gen., in Table R2, where Full SCORED still leads in physical-evaluation yields.
- Stratification by competitor count (Table A.4): Follow your valuable suggestion, we stratify the three-seed scores of Table A.2 by number of competitors found () in Table R2, where is the complete panel. We observe that Full SCORED gets the best (lowest) competition score across all five strata. Gains are therefore not an artifact of differential competitor coverage.
Table R1 -- Per-seed Evaluation Funnel of the Actual Runs of SCORED (as reported in Table 2)
| Seed | Valid | Unique | Conf. | Target | Joint | Joint / Gen. |
|---|---|---|---|---|---|---|
| 0 | ||||||
| 1 | ||||||
| 2 | ||||||
| Mean / pooled | (sum) |
Table R2 -- Comparison of Competition Scores per Stratum (lower is better) and Post-Validation Yields (higher is better)
| Full SCORED | − competitor contrast | − denoising reward | − RWR initialization | |
|---|---|---|---|---|
| (complete panel) | ||||
| Joint/Gen. | 37.7% | 15.6% | 36.9% | 28.0% |
W2 & Q2: Clarification of Cross-Domain Specificity with Multi-Seed SBDD Experiments Supporting Our Generalization Hypothesis and Comparison with Target-only
Follow your valuable suggestion to provide a Target-only ablation for TargetDiff, we repeated over three seeds with three matched experiments: Full SCORED (contrast + QED/SA), Target-Only (negative target denoising error + QED/SA, dropping the off-target term), and Without SCORED (QED/SA only) (§5.4, Appendix H.3, Tables A.17 to A.18) and observed the following:
- TargetDiff:
- Comparing with
without SCOREDorTarget-only, the difference is likewise indistinguishable with the same gain of kcal/mol. Because TargetDiff lacks pre-RL alignment (), neither the target-only error nor the target-competitor contrast carries a valid signal, which directly supports our conditional generalization claim.
- Comparing with
- AliDiff vs. IPDiff (§5.4, Appendix H.4, Table A.19):
- IPDiff () observed mixed results with mean gain of .
- AliDiff, which finetunes on top of IPDiff for affinity alignment (), improved in all three seeds with mean gain of .
- Together, the three-seed replication of SBDD generalization experiments supports our generalization hypothesis where SCORED works on backbones with positive pre-RL alignment .
Table R3 -- Three-seed TargetDiff Results (kcal/mol)
| Seed / Summary | Pockets | Without | Target-Only | Full | (Full Target-Only, 95% CI) | (Full Without, 95% CI) |
|---|---|---|---|---|---|---|
| 2026 (Table 3 run) | 30 | (20/30 wins) | (23/30 wins) | |||
| 2027 | 29 | (20/29) | (15/29) | |||
| 2028 | 29 | (10/29) | (13/29) | |||
| 3-seed pooled | 29 | (19/29) | (16/29) |
Table R4 -- Selectivity Gain of AliDiff and IPDiff (kcal/mol, mean$\pm$std over three seeds)
| Backbone | Without SCORED | With SCORED | |
|---|---|---|---|
| AliDiff () | |||
| IPDiff () |
Response to Reviewer 4TWB (revisions in orange)
We sincerely thank you for the careful reading of our controls, derivations, and scope qualifications, and for three diagnostic questions on funnel filtering, competitor-count coverage, and single-seed variability. We detail our response below point by point. Please kindly let us know if our response addresses the issues you raised in this paper.