- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Progress-Annealed Candidate Selection (PACS), a training-free method for guiding masked diffusion models toward cell-type-specific regulatory DNA. Motivated by evidence that positionwise MAP lookahead scores provide unreliable candidate rankings early in denoising, PACS standardizes scores within each parent’s candidate pool and progressively increases selection strength as more nucleotides are revealed. The authors provide a local KL-regularized interpretation of the selector and establish large-pool consistency under stated assumptions.
Evaluation covers three human cell-line activity tasks and eight immune-cell accessibility tasks, using separately trained evaluation oracles, comparisons with greedy search and other design methods. PACS consistently improves motif-frequency, sequence-composition, and embedding fidelity relative to matched greedy search while retaining competitive predicted specificity.
Critical strengths
-
The paper identifies that in diffusion search, MAP lookahead rankings are poorly informative early in denoising and improve as sequence context accumulates. PACS addresses this through a simple selection schedule, and its comparison with greedy search holds the comparable setups. This provides convincing evidence that changing candidate selection can improve the specificity–fidelity trade-off without retraining.
-
PACS improves motif-frequency correlation, 3-mer correlation, and embedding fidelity over matched greedy search across all three cell lines and eight immune-cell targets, while maintaining competitive predicted specificity. Separately trained evaluation oracles and complementary motif-arrangement metrics strengthen the validation. This consistency supports the practical usefulness of the approach beyond a single design task.
Critical weaknesses
- The broader comparison does not establish that the proposed selector is preferable to adequately resourced existing methods. PACS evaluates 2,048 candidates per parent and reports the best retained completion along each lineage, whereas the main SVDD baseline uses ten candidates and returns terminal outputs. Differences in search budget, candidate valuation, and output selection therefore accompany differences in method. Additional budget sweeps partially address this concern, but do not jointly control these factors.
Questions for authors
- After accounting for Appendix E.3’s candidate-budget sweeps, which advantages over SVDD remain attributable to PACS’s selection rule? Are comparisons available using the same candidate valuation and output-reporting rule?
- PACS improves sequence fidelity relative to greedy selection, but its specificity gains are target-dependent. Under what conditions should PACS be preferred over greedy selection? Can the main results establish whether PACS achieves better fidelity at comparable specificity, particularly for targets where specificity decreases?
3 comments
Response to Reviewer mgPn (2/2)
Re Q2: PACS offers better fidelity at comparable specificity
The intended application of PACS is to design regulatory DNA for targeted gene expression in gene therapies, which requires both high predicted specificity in the desired cell type and sequence fidelity relative to natural regulatory DNA. PACS is most useful when it improves both, as on HepG2 and K562 above. When a trade-off exists, PACS should be preferred if it meets the required specificity threshold and improved fidelity is valuable for the application. To examine this directly, we analyzed the SK-N-SH branching-factor sweep, where the main results favor greedy selection over PACS on specificity.
| Branching factor B | Metric | Greedy Selection | PACS |
|---|---|---|---|
| 32 | AlphaGenome MinGap ↑ | 3.420 ± 0.056 | 3.409 ± 0.076 |
| 32 | Motif correlation ↑ | 0.788 ± 0.032 | 0.799 ± 0.007 |
| 32 | 3-mer correlation ↑ | 0.918 ± 0.003 | 0.921 ± 0.002 |
| 32 | NTv2 FBD ↓ | 2.061 ± 0.035 | 1.977 ± 0.035 |
| 64 | AlphaGenome MinGap ↑ | 3.900 ± 0.092 | 3.922 ± 0.035 |
| 64 | Motif correlation ↑ | 0.817 ± 0.042 | 0.833 ± 0.018 |
| 64 | 3-mer correlation ↑ | 0.922 ± 0.007 | 0.937 ± 0.007 |
| 64 | NTv2 FBD ↓ | 2.131 ± 0.048 | 1.969 ± 0.008 |
| 2048 | AlphaGenome MinGap ↑ | 5.387 ± 0.036 | 5.125 ± 0.120 |
| 2048 | Motif correlation ↑ | 0.784 ± 0.013 | 0.819 ± 0.029 |
| 2048 | 3-mer correlation ↑ | 0.897 ± 0.010 | 0.915 ± 0.016 |
| 2048 | NTv2 FBD ↓ | 2.403 ± 0.058 | 2.126 ± 0.033 |
At and 64, mean MinGap differs by only −0.011 and +0.022, respectively, while PACS reduces FBD by 4.1% and 7.6% and also improves motif-frequency and 3-mer correlations. These results support better fidelity at comparable mean specificity and equal candidate budgets.
The revised comparisons show that fidelity gains persist against SVDD after matching the oracle budget and terminal reporting and identify specific examples with improved fidelity at comparable specificity. We thank the reviewer again for suggestions that strengthened the study.
Thank you for the additional experiments. The matched-budget comparisons address much of my concern about the original evaluation and strengthen my confidence in the results. I find the analysis of MAP ranking quite interesting, and PACS provides a well-motivated approach to acting on that observation. Together with the theoretical analysis and empirical evaluation, this makes a useful contribution. Overall, the rebuttal reinforces my positive assessment, and I will maintain my recommendation.
Response to Reviewer mgPn (1/2)
We thank the reviewer for their positive assessment and for recognizing the MAP-ranking diagnostic, the evidence for improving the specificity–fidelity trade-off without retraining, and the consistent fidelity gains across cell types. Our response adds (1) a comparison with SVDD-PM at matched oracle budgets and common terminal reporting and (2) evidence of improved fidelity at comparable specificity.
Re W1 & Q1: PACS improves the specificity–fidelity trade-off over SVDD at matched compute and terminal reporting
We agree that the main comparison combines differences in budget, valuation, and output reporting. To isolate the selection rule’s contribution, we compare SVDD-PM and PACS using the same oracle-evaluation budget and terminal outputs (last branch) for every method. We provide an extended comparison with SMC/TDS in our response to reviewer wxZH (W2).
PACS reduces FBD relative to SVDD-PM by 8.9%, 9.9%, and 10.6% on HepG2, K562, and SK-N-SH, and improves motif-frequency and 3-mer correlations on all three targets. It increases specificity on HepG2 and K562 but decreases it on SK-N-SH, at comparable runtime. We have updated the main benchmark figure with these budget-matched results.