- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the problem of identifying effective siRNA target sites on unseen genes, where limited experimental data can cause conventional efficacy predictors to overlook promising target regions. To address this challenge, the paper proposes siDiff, an efficacy-guided discrete diffusion framework that learns a target-conditioned distribution of functional siRNA sequences and guides candidate generation toward potentially effective regions. The proposed method combines coarse-to-fine sampling with position-level and nucleotide-level efficacy guidance, followed by reverse-complementary candidate construction and cluster-aware selection to preserve regional diversity. The main contributions include a generative framework for siRNA target-site discovery, a biology-aware guided sampling strategy, and three patent-derived evaluation benchmarks with positional accuracy and regional coverage metrics. Experiments on the Takayuki benchmark and three unseen patent-derived targets demonstrate improved target-site recovery and coverage of distinct high-efficacy regions compared with conventional enumeration-based methods and diffusion baselines.
Critical strengths
Applying a discrete masked diffusion process to the siRNA candidate ranking problem is a fresh and interesting approach. Cluster-Aware Redundancy Mitigation was impressive, as it helps to reduce redundant candidates whilst maintaining diversity across different target domains.
Critical weaknesses
Although this may be a limitation of the task itself, the contribution of this work to therapeutic discovery seems limited to computational target-site recovery, rather than actual therapeutic discovery. The baselines used in this study are somewhat outdated, and comparisons with more recent SOTA models are missing. It is also disappointing that the paper does not provide a detailed case study of individual target sites identified by the proposed model, although regional coverage analyses are presented.
To make the manuscript more concrete, I believe it would be helpful to evaluate the proposed model on an siRNA efficacy prediction task and compare it with SOTA methods. Demonstrating strong prediction performance or showing that the model learns biologically meaningful representations would make this work much more convincing.
The authors claim that generative proposals can recover effective mRNA regions that existing predictors fail to identify. However, the main experimental results primarily measure whether the model correctly recovers specific annotated active positions. There is no direct analysis showing how siDiff recovers regions that were incorrectly ranked by existing predictors. Therefore, there is a gap between the authors' main claim and the experimental evidence presented in the paper.
[1] Gao, Bowen, et al. "Drugclip: Contrastive protein-molecule representation learning for virtual screening." Advances in Neural Information Processing Systems 36 (2023): 44595-44614.
Questions for authors
-
The latent diffusion decoder of RNAGenesis[1] can generate RNA sequences based on context. I believe comparisons with models such as RNAGenesis, RiNALMo[2], RNA-FM, or even protein foundation models such as the ESM family would be valuable. Several categories of recent SOTA models have been introduced that could potentially be applied to siRNA-related tasks. As an additional suggestion, have the authors considered incorporating therapeutic feature? Could the authors provide a head-to-head performance comparison with these models, adapted to the task addressed in this paper? I believe such results would make the manuscript more concrete and convincing.
-
If the proposed model performs well in position recovery and clustering, it is anticipated that it will also be able to learn representations useful for predicting siRNA efficacy.
-
According to Appendix Table 10, OligoFormer shows a relatively stronger correlation with experimentally measured efficacy but achieves lower target-site recovery performance. In contrast, siDiff achieves higher position recovery performance despite using a predictor with weaker efficacy correlation. Could the authors explain why this happens and which components contribute most to this difference?
-
Regarding the dataset construction, please provide a reference or justification for choosing the inhibition threshold of 0.7. It would also be helpful to show whether the results remain consistent under different thresholds.
[1] Zhang, Zaixi, et al. "RNAGenesis: a generalist foundation model for functional RNA therapeutics." bioRxiv (2024): 2024-12.
[2] Penić, Rafael Josip, et al. "RiNALMo: general-purpose RNA language models can generalize well on structure prediction tasks." Nature Communications 16.1 (2025): 5671.
3 comments
4. [W1, W3] Potent sites ranked near the bottom by iScore, OligoFormer, and siRNADiscovery are recovered within 1–3 nt, as detailed in the common comments
Please refer to Section 1 of the Common Official Comments for the coordinate-verified strict Hit3@3 cases. All three sites have normalized inhibition above 0.91, yet the corresponding baseline ranks each in the bottom three of the 41 local candidates, at 40/41, 39/41, and 39/41. siDiff places a final top-three proposal within 3, 1, and 2 nt, respectively. The OligoFormer and siRNADiscovery sites are already within 1–2 nt of siDiff's top-1 prediction. For the iScore site, the top-1 distance is 14 nt, and the top-three portfolio supplies the candidate at 3 nt. The corresponding baseline scores are 29.3, 0.388, and 0.429. These are strict Hit3@3 successes under the unchanged evaluation rule, and they show the benefit of a small, diverse proposal set over a single pointwise maximum.
5. [W2, Q2] A regression head on frozen Diffusion representations predicts held-out inhibition with PCC 0.536 and SCC 0.548
We thank the reviewer for asking whether Diffusion learns an efficacy-aware representation, rather than only sequence regularities sufficient for masked-nucleotide reconstruction. We tested this with a frozen-representation transfer experiment. Clean siRNA inputs were passed through the trained CondDiT, its internal representations were pooled, all Diffusion parameters were frozen, and only a lightweight regression head (two linear layers and one activation function) was trained to predict continuous experimental inhibition. Evaluation was performed on the four held-out external targets.
| Evaluation scope | PCC | SCC | RMSE |
|---|---|---|---|
| Four held-out external targets | 0.536 | 0.548 | 0.0920 |
The frozen Diffusion representation achieves a PCC of 0.536 and an SCC of 0.548. It therefore retains a clear efficacy-related signal that transfers to unseen target contexts.
6. [Q3] Table 10 evaluates only the lightweight post-hoc scorer; siDiff's recovery comes from the full proposal pipeline
Appendix Table 10 evaluates the lightweight predictor used only for rapid post-generation scoring and candidate filtering. OligoFormer uses a longer 57-nt mRNA context and thermodynamic features, and it is optimized as a dedicated efficacy-prediction model. It is therefore reasonable that OligoFormer obtains stronger standalone PCC/SCC values in Table 10.
The complete siDiff framework still achieves stronger target-site recovery than the OligoFormer enumeration baseline, because its output is not obtained by globally sorting all 41 candidates with this lightweight full-sequence predictor. It comes from the diffusion model during multi-step generation.
The predictor serves only as a rapid downstream scoring and filtering component within a broader proposal-and-selection process that combines:
+ \text{partial-state efficacy guidance} + \text{reverse-complement candidate construction} + \text{region-level consensus selection}.$$ ## 7. [Q4] The 0.7 inhibition cutoff follows prior siRNA design practice and public implementations, rather than test-set tuning The normalized inhibition threshold of $0.7$ was adopted from established siRNA efficacy practice rather than selected post hoc from our test results. The convention is explicit in both classical design work and recent predictors. OligoWalk defines an efficient siRNA as one with **greater than 70% silencing efficacy** [Lu and Mathews, *Nucleic Acids Research*, 2008](https://doi.org/10.1093/nar/gkn250). More recently, the official OligoFormer implementation converts measured efficacy into the positive class using `label > 0.7` ([official](https://github.com/lulab/OligoFormer/blob/main/scripts/test.py) `test.py`), and the official siRNADiscovery implementation uses the same `efficacy > 0.7` boundary for its binary efficacy evaluation ([siRNA-split code](https://github.com/BertramLoong/siRNADiscovery/blob/main/siRNA_split/siRNADiscovery.py); [mRNA-split code](https://github.com/BertramLoong/siRNADiscovery/blob/main/mRNA_split/siRNADiscovery.py)). These recent models are built on the influential 2,431-siRNA Huesken benchmark reported in *Nature Biotechnology* [Huesken et al., 2005](https://doi.org/10.1038/nbt1118), which was produced in an industrial drug-discovery setting by researchers from Novartis and Compugen. Thus, the 70% activity boundary has precedent across classical siRNA design, modern efficacy prediction, and industry-generated screening data.Thank you for providing the additional experiments and detailed explanations. The new comparative analyses with recent models, including RNAGenesis, and the additional case studies demonstrating that siDiff can recover active sites that were ranked lower by existing prediction models, were most appreciated. However, I remain concerned that the scope of the problem formulation is relatively narrow. The three case studies are interesting, but I still believe they are insufficient to demonstrate that the model can consistently recover promising regions overlooked by existing prediction models across a diverse range of unknown genes. I also appreciate the explanation regarding Q3, but the relative contributions of individual components to the performance improvement remain somewhat unclear. Therefore, the additional results have addressed some of my concerns, but my main concerns regarding the scope of this study and the empirical evidence remain. I therefore maintain my original score.
Response to Reviewer 3
We sincerely thank the reviewer for the constructive assessment. These comments help us make both the scope and the empirical evidence of the work more concrete.
1. [W1, Q1] siDiff proposes diverse binding regions for downstream screening for therapeutic development instead of efficacy prediction
The intended contribution of siDiff identifying a compact and spatially diverse set of promising target regions and valid siRNA candidates for downstream experimental screening.
The output is the siRNA binding regions rather than an efficacy score. Predicting efficacy requires a ranking model that outputs the exact siRNA efficacy score.
Our goal is to recover several promising and non-redundant target regions rather than to concentrate the full candidate portfolio in one local region. siDiff is designed to accelerate candidate proposal and experimental prioritization at this stage.
2. [W1, Q1] siRNADiscovery is compared directly; adapted generators are in the common comments, and the remaining suggested models do not fit this task
We appreciate the recommendation to include more recent methods. We will extend the empirical comparison to models that can be reproducibly adapted to conditional siRNA generation or target-site proposal shown in the common comments section 1 :
We also add siRNADiscovery into our benchmark
For the comparison with the autoregressive Transformer, the conditional autoencoder, and the conditional VAE under the shared downstream protocol, please refer to Section 1 of the Common Official Comments.
We also evaluated RNAGenesis. Its original configuration is not designed for 21-nt siRNA generation conditioned on a target mRNA. To adapt it, we modified its denoiser to support the required sequence length and fine-tuned it on the Huesken data with mRNA conditioning. Under the same reverse-complement matching protocol with a mismatch tolerance of 5, RNAGenesis produced no valid siRNA candidate on any of the four external test datasets. The generation success rate is 0% for Takayuki, ANGPTL7, CTNNB1, and GSK3A. We report this result for completeness. It indicates that adapting a general RNA generator to target-complementary siRNA proposal requires more than changing its output length and fine-tuning it on this task.
We also investigated the suggested siDPT comparison. Its executable implementation and source code are not publicly available.
The other suggested foundation models do not provide a compatible siRNA-generation interface. RiNALMo and RNA-FM are RNA representation models rather than mRNA-conditioned 21-nt siRNA generators. ESM operates on proteins, and DrugCLIP is designed for protein–small-molecule screening. Their native outputs cannot generate and rank reverse-complementary siRNA candidates for a target mRNA, so they are not direct proposal-model baselines.
3. [W3] Hit0@1, Hit3@3, and EWC measure recovery of active sites and regions that discriminative rankings do not place first
The improved Hit0@1, Hit3@3, and EWC results show that siDiff recovers experimentally active sites and regions more effectively than the evaluated discriminative ranking pipelines on unseen targets. In particular:
Together, these results show that the generative proposal-and-selection process can recover active positions and regions that the discriminative baselines do not place at the top. This recovery is practically useful because it identifies localized regions for subsequent experimental validation rather than relying only on a single predictor ranking.