- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper focuses on the problem of protein-conditioned RNA generation, an important and active area of research that remains computationally unsolved. In contrast to standard approaches, the authors propose generating the RNA structure within coordinate frames independent of the protein target. Their framework, RiboBridge, operates in four main stages: 1) Identification of potential binding sites on the protein: 2) Selected binding site protein residues conditioned generation of RNA structure; 3) Cross-frame interaction prediction; 4) Guided rigid assembling.
Critical strengths
- The targeted problem is of high practical importance, and novel methodological approaches are welcome.
- The evaluation set preparation protocol is fully clear, sound and fair.
- The manuscript is well-written, easy to follow, and the results are clearly presented.
- The authors conduct systematic ablations across the pipeline stages to validate their architectural choices.
Critical weaknesses
- A significant portion of the evaluation (Table 1) relies on direct comparison to ground-truth structures. Given the generative nature of the task, where a single protein can bind diverse RNA sequences and structures, this metric is not suitable.
- The reported values for fNAT, iRMSD, lRMSD, scLRMSD, scTM, and designability are very poor across all baselines as well as RiboBridge itself, especially considering preemptive oracle and DockQ based filtering. Restoring at most 5% of contacts alongside an scLRMSD around 40 Å indicates that none of the evaluated methods are currently near practical usability. Comparing methods under such baseline performance is uninformative, particularly without error bars.
- Relying on oracle RNA length and oracle-based candidate selection deviates significantly from real-world application scenarios.
- The manuscript does not analyze or discuss the novelty and diversity of the generated entities.
Questions for authors
- Is RNA length used to condition the generation comes from ground truth structure, or was there another protocol for its selection?
- Is the number of identified binding sites the only reason there are multiple candidate structures?
- Could you please release the code to improve paper's reproducibility?
- Could you double check the references for correctness? Some authors names are inaccurately reported.
6 comments
Thank you for the detailed response.
I consider the novelty and diversity issues to be resolved. I also thank the authors for sharing their code.
However, I do not agree that comparisons with native structures and related metrics (RMSD, DockQ) are suitable for evaluating generative models. Additionally, generating a single sample per condition is not standard practice. I recommend that the authors focus on AF3-based metrics and generate a suite of samples per target, which will allow for selecting the best candidate (thus improving performance) and provide a clearer picture of the model’s overall performance.
Furthermore, using the oracle RNA length prevents us from understanding the model’s performance in a real-world scenario, where such information is unavailable. I recommend generating samples across a reasonable range of lengths, which is fully compatible with AF3-based evaluation.
The current state of the evaluation is the main reason preventing me from raising my score.
Dear Reviewer pT3e,
Thank you for your thoughtful follow-up and valuable suggestions. We agree that generative evaluation should extend beyond native-reference recovery. We are therefore conducting additional experiments on multi-sample generation, variable RNA lengths, and AF3-based self-consistency.
We respectfully believe that native-reference metrics remain valuable for measuring recovery of experimentally observed binding modes, while reference-free metrics assess complementary aspects of generative quality. Similarly, RNA length is a user-controlled design variable, although evaluating multiple lengths would better characterize practical applications.
We are running these additional experiments and will share the results shortly. We sincerely appreciate your constructive feedback.
Best,
The authors
Dear Reviewer pT3e,
Thank you for the detailed feedback. We respond below.
W1. Native-reference metrics
W2. Performance, utility, and statistical reliability
W3 & Q1. Oracle RNA length and candidate selection
W4. Novelty and diversity of generated RNAs
Q2. Multiple candidate generation.
Q3. Code availability.
Q4. Reference correctness.