- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper performs RNA inverse folding: it generates a nucleotide sequence from a 3D RNA backbone. The backbone is a base-neutral graph of three atoms per nucleotide, and a masked discrete flow model with a GVP encoder and a bidirectional decoder reveals masked nucleotides in parallel in K = 8 steps, independent of sequence length. Training combines 4,025 experimental structures with 5,850 Boltz-predicted structures of Rfam sequences, after which the model is fine-tuned by best-of-N distillation on structurally selected sequences paired with native sequences. It reports TM 0.445, lDDT 0.619, RMSD 9.380 A and recovery 55.9% on 88 test backbones, and sampling is 12.8x faster than order-agnostic autoregression, with +0.016 TM at N = 16.
Critical strengths
-
The parallel decoder gives a measured efficiency gain under a controlled comparison. At K = 8 the median latency is 115 ms, against 19.14 ms per nucleotide for the order-agnostic autoregressive baseline with the same geometric network and data. At N = 16 the TM-score is 0.5196 versus 0.5033, so the 12.8x speedup comes with +0.016 TM; at an equal 1.84 s budget it produces 16 candidates against one, a +0.119 TM difference.
-
The paper shows with a controlled substitution experiment that higher recovery does not mean a better structure. Within the same design, restoring mismatched paired bases to their native identities raises recovery from 0.5155 to 0.7608 while ViennaRNA base-pair F1 falls by 0.2743, and every intermediate dose has a paired interval below zero (Figure 2A). Recovery alone therefore does not measure structural quality.
Critical weaknesses
-
The accuracy claims are not supported by the paper's own paired tests. Table 6 resolves only the comparisons against RIDE (lDDT +0.048, p = 0.003; recovery +0.115, p = 0.028); all 14 intervals against NA-MPNN, gRNAde and the w/o-Rfam variant cross zero, as do the four intervals for Rfam augmentation. The gap over NA-MPNN is 0.004 TM (0.445 vs 0.441, p = 0.829), yet the abstract reports the highest TM-score, lowest RMSD and highest recovery. These are point-estimate rankings, not established improvements.
-
The sampling step count is fixed at K = 8 and never varied. Without a K = 1 result, it is unknown how much quality is lost by collapsing the eight steps into one. If K = 1 matches K = 8, the multi-step flow adds nothing to quality and the benefit comes from parallel decoding alone.
Questions for authors
-
How much TM-score, lDDT and recovery are lost at K = 1, 2 and 4 relative to K = 8? Please report these five settings. If K = 1 is comparable to K = 8, what does the discrete flow add beyond parallel decoding?
-
RiboDiffusion is discussed in Sections 1 and 2.1 but absent from Table 1. Please add it, or state why it cannot be trained under the same three-atom representation; the same applies to RhoDesign and RiboPO.
-
Table 5 reports one clean-test sequence at 80%/80% local identity and coverage on both sides, and 10 at 80%/80% on the shorter sequence, while Section 3.3 mentions only the absence of exact matches. Please state this in the main text and re-report the Rfam comparison with those 10 test sequences excluded.
-
The distillation comparison uses one fine-tuning seed and 45 backbones, with differences of +0.0105 to +0.0145 TM and standard errors of 0.005 to 0.008. Please repeat it with at least one additional seed.
-
The abstract reports the highest TM-score, lowest RMSD and highest recovery, while Table 6 shows 14 of 16 paired intervals crossing zero. Please label these as point estimates in the abstract.
-
Appendix A states that the encoder processes a single target conformation, while gRNAde supports conformational ensembles. Please state this scope in the main text.
4 comments
Response to Reviewer nSuD (2/2)
Q2. Additional baseline comparisons
The revised Table 1 includes RiboDiffusion, RhoDesign and RiboPO, alongside Struct2SeQ and RIDE. The expanded benchmark evaluates nine methods on the same 88 clean-test records, using the same candidate budget and structural evaluation protocol.
As shown in our response to W1, RNA-DFM achieves the best observed performance across all four metrics under both mean-of-16 and best-of-16 evaluation.
Q3. Sequence contamination and sensitivity analysis
We thank the reviewer for identifying the ambiguity in Table 5. The reported count of 10 represents local alignment hits rather than 10 distinct test sequences. All clean-test local matches involve the same PDB entry, 2OEU chain A, corresponding to a single test-manifest record (RS_03411_0_2OEU_1_A).
We have clarified the counting unit and local-identity criterion in the main text.
To directly address the concern, we repeated the Rfam augmentation comparison after excluding this affected record. Since the record forms a singleton at each level of the hierarchy, its exclusion removes one complete structural family, leaving 87 records across six families.
| Metric improvement | 88 records (7 families) | 87 records (6 families) |
|---|---|---|
| TM-score | +0.0788 | +0.0806 |
| lDDT | +0.0782 | +0.0819 |
| RMSD reduction (Å) | 1.63 | 2.87 |
Excluding the potentially overlapping record preserves and slightly strengthens the augmentation gains. The paired differences retain their directions under all four weighting schemes.
This sensitivity analysis demonstrates that the effectiveness of Rfam augmentation does not depend on the identified local sequence overlap.
Q4. Additional fine-tuning seed for distillation
We have addressed the requested replication by evaluating two independent fine-tuning seeds for each distillation configuration. Each seed is paired with its own matched uniform-weight control, using the same initial checkpoint and candidate pool.
The reported paired differences are averaged across the two fine-tuning seeds within each record before aggregation, and the evaluation now covers all 88 clean-test records rather than 45 backbones.
| Label weighting | Best-of-16 TM-score gain | 95% CI |
|---|---|---|
| N = 2 | +0.0147 | [+0.0013,+0.0281] |
| N = 4 | +0.0112 | [−0.0028,+0.0252] |
| Argmax | +0.0047 | [−0.0112,+0.0205] |
N = 2 weighting improves 60% of the test records relative to the matched control. Its confidence intervals exclude zero from candidate budgets of four upwards, demonstrating benefits beyond a single selection budget.
The observed ordering across label-weighting strategies supports the motivation for using softer order-statistic weighting rather than restricting supervision to only the highest-scoring candidate.
Q5. Abstract and interpretation of accuracy claims
The abstract has been revised according to the updated family-weighted evaluation. It reports RNA-DFM's observed performance among the nine evaluated methods, while distinguishing these benchmark results from statistically supported improvements established through controlled ablations. In particular, the augmentation effect is supported by our matched experiments and additional statistical analysis.
Q6. Single-conformation input
RNA-DFM is designed for RNA inverse folding conditioned on a specified target backbone conformation. Our benchmark evaluates both RNA-DFM and gRNAde under the same single-conformation setting, ensuring a consistent comparison. Ensemble-conditioned design represents a distinct problem setting.
Summary
The revision addresses the reviewer's principal concerns through an expanded nine-method benchmark, a controlled sampling-step ablation, a contamination-exclusion sensitivity analysis, and two-seed distillation experiments over the full clean-test benchmark.
In particular, the substantial quality improvement from K = 1 to K = 8 demonstrates the contribution of multi-step flow generation, while the contamination sensitivity analysis and replicated distillation experiments strengthen the evidence for our training contributions.
Thank you for the additional experiments. The K ablation addresses my main concern about multi-step generation. The added baselines, overlap clarification, and second fine-tuning seed also strengthen the evaluation.
Regarding the paired tests, non-significant results do not establish equivalence. The new evidence supports Rfam augmentation, while rankings against competing methods should remain descriptive. Please report both weighting schemes and keep this distinction clear.
Most of my concerns are now addressed. I am updating my recommendation from weak rejection to weak acceptance.
Thank you for your constructive feedback and for reconsidering our work! We appreciate your suggestions regarding statistical interpretation and the reporting of both weighting schemes.
Response to Reviewer nSuD (1/2)
We thank the reviewer for the constructive and specific feedback. The additional experiments directly address the two central concerns regarding structural accuracy and the contribution of multi-step flow generation.
As described in our response to all reviewers, the revised benchmark weights the seven structural families equally rather than BGSU equivalence classes. This provides a more balanced assessment of cross-family generalisation and changes our headline TM-score from 0.445 to 0.414.
W1. Structural accuracy and statistical evidence
The revised evaluation provides stronger empirical support for RNA-DFM across both generation and selection regimes. Table 1 now compares nine methods on the 88 clean-test records.
Mean-of-16 results:
Best-of-16 results under Boltz selection:
RNA-DFM achieves the best observed performance across all eight metric–evaluation combinations. Its leading performance in both mean-of-16 and best-of-16 indicates that the observed advantage is not dependent on structural selection.
Against the strongest baseline per metric, the best-of-16 improvements are +0.087 recovery, +0.019 TM-score, +0.024 lDDT and a 0.37 Å reduction in RMSD.
Statistical evidence for augmentation. The matched Rfam ablation provides particularly strong evidence for additional structural supervision. The paired improvements are +0.079 TM-score, +0.070 recovery and +0.078 lDDT, with family-level 95% confidence intervals of [+0.056,+0.100], [+0.014,+0.127] and [+0.020,+0.136], respectively. All exclude zero, and the improvements remain directionally consistent under all four weighting schemes.
Cross-family robustness. Relative to NA-MPNN, RNA-DFM leads on five of seven structural families. Cluster 237, where RNA-DFM has a TM-score difference of −0.069, accounts for 59.1% of the records, explaining the sensitivity to aggregation. Excluding any individual family preserves positive TM-score gains (+0.022 to +0.049).
Together, these results demonstrate consistent empirical performance across evaluation regimes and family compositions, complemented by statistically supported improvements from structural augmentation.
W2 and Q1. Contribution of multi-step flow generation
We have conducted the requested controlled ablation over K = 1, 2, 4 and 8, holding the checkpoint, candidate budget (16), temperature (0.1), 5′-to-3′ order, Boltz selection, Protenix scoring and family weighting fixed.
Increasing K from 1 to 8 improves TM-score by 0.066, lDDT by 0.089, recovery by 0.029, and reduces RMSD by 4.83 Å.
The pooled candidate widths are 10.0, 10.4, 10.0 and 9.9, respectively, indicating comparable candidate-pool widths across the four settings.
These results directly demonstrate the contribution of multi-step generation beyond parallel decoding alone. Progressive conditioning on previously revealed nucleotides substantially improves structural fidelity, with consistent gains across all four metrics. The results are reported in Figure 2A and Appendix F.