- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces D3LM, a bidirectional generative DNA model that retains the Nucleotide Transformer architecture and replaces fixed-rate masked language modeling with a masked-diffusion objective. It supports both iterative sequence generation and representation learning for downstream genomic tasks. The authors also propose Motif-Inpainting Policy Optimization (MIPO), which uses diffusion RL by inserting cell-associated motifs into high-scoring sequences and regenerating their local neighborhoods. The authors evaluate unconditional generation, 18 genomic classification tasks, and cell-specific regulatory design, showing competitive results against the baselines.
Critical strengths
-
The paper explores masked diffusion as a framework for capturing bidirectional context in DNA sequences, achieving competitive performance on both sequence generation and downstream classification tasks. This demonstrates the potential of a single DNA model to support both generation and representation learning.
-
The paper introduces MIPO, a motif-guided RL strategy for functional DNA design. MIPO explores around promising sequences by inserting regulatory motifs and inpainting their local neighborhoods while preserving the surrounding context. Under matched scoring budgets and shared optimizer hyperparameters, it substantially improves predicted specificity in HepG2 and moderately improves SK-N-SH. The shuffled-motif ablation further supports the contribution of motif structure beyond additional proposal generation or nucleotide composition.
Critical weaknesses
-
MIPO selects high-scoring parent sequences and accepts inpainted proposals using the same reward model that supplies RL feedback and evaluates the final generated sequences. Consequently, the reported gains may reflect increasingly effective optimization of that predictor rather than improved biological function. Validation with an independent predictor or experimental assay is needed to assess whether these improvements generalize beyond the training reward model.
-
The specific benefit of bidirectional diffusion modeling is insufficiently demonstrated. D3LM retains the NT architecture and primarily changes its training objective, but the paper lacks a controlled comparison against an autoregressive variant using the same backbone. A matched NT baseline would also help isolate the contribution of diffusion training. Furthermore, the introduction claims that left-to-right autoregressive modeling cannot adequately capture downstream regulatory relationships, but the experiments do not directly test this limitation. This motivation requires stronger evidence.
Questions for authors
-
Could the authors report scores for ordinary generated sequences, selected parents, and their corresponding inpainted sequences? This would separate the gain from parent selection from the additional gain due to motif insertion. A training control that reuses 1. all genereted sequence + motif insertion, and 2. selected high-scoring parents without motif insertion would also help establish whether MIPO’s improvement over d1 comes from its motif-guided exploration or simply from emphasizing high-reward sequences.
-
Although the paper includes published NT-v2 classification results, could the authors add an NT baseline continued on the same data with the same training budget while retaining its original masked-language-modeling objective? Comparing downstream performance and generation quality, with an explicit sampling procedure for NT, would help isolate the contribution of diffusion training.
-
How does D3LM differ from D3 [1] and the Dirichlet Diffusion Score Model [2]? Comparisons using matched datasets, sequence lengths, and training budgets would help establish whether D3LM offers better generation quality or functional controllability.
-
How does D3LM with MIPO compare with existing RL-based DNA design methods, such as TACO [3], Ctrl-DNA [4], and GO-CRE [5]? A shared evaluation setting with matched scoring budgets, and clear reporting of motif priors and inference-time filtering, would make the relative benefits easier to assess.
References
[1] Sarkar et al. Designing DNA With Tunable Regulatory Activity Using Discrete Diffusion. bioRxiv, initial preprint 2024. https://doi.org/10.1101/2024.05.23.595630
[2] Avdeyev et al. Dirichlet Diffusion Score Model for Biological Sequence Generation. ICML, 2023. https://proceedings.mlr.press/v202/avdeyev23a.html
[3] Yang et al. Regulatory DNA Sequence Design with Reinforcement Learning. ICLR, 2025. https://arxiv.org/abs/2503.07981
[4] Chen et al. Ctrl-DNA: Controllable Cell-Type-Specific Regulatory DNA Design via Constrained RL. NeurIPS, 2025. https://arxiv.org/abs/2505.20578
[5] Ma et al. Reconstructing sequence-grammar trajectories enables interpretable and tunable cis-regulatory element design. bioRxiv, 2026. https://doi.org/10.64898/2026.07.10.737719