- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
RIVET is a framework for RNA inverse folding which uses iterative seq editing instead of generating a complete seq in a single pass. The framework has 4 components: 1) SKETCH, an LLM-based policy which proposes edits with reasoning traces, 2) ECHO, a learned world model to predicts changes in structure quality, 3) SCOUT, selects promising edits for verification, 4) GAUGE, an energy-based verifier which provides reward signals & conformal acceptance criterion. Experiments show increased performance over the baselines on the RNA 3D IF task, and include the 2D structure agreement and generalization on RNA families, and predicted property proxies.
Critical strengths
- The formulation of RNA inverse folding as iterative editing. The framework is flexible to accommodate additional seq and functional constraints. The combination of the world model is novelty & fancy with structural selective verification.
- The evaluation is complete including seq recovery, 3D sc-score, 2D agreement, and different RNA families, which is more mature compared with other counterparts in the RNA inverse folding area.
Critical weaknesses
(Major) RIVET intros a new backbone conditioned initializer + SKETCH, ECHO, SCOUT, GAUGE. The framework looks promising at the first glance, but those fancy components seems to be enforced together form an extremely novel system with limited empirical improvements.
The table 1 only compares the whole system with other methods. I have this concern because, in Table 4 ablation results, the full depth-3 editing improves mean scTM by only 0.0058 (seq recovery lowered by 0.0042 after editing) on the 60-targets. The reported no-edit reference has mean scTM 0.418, and ECHO-only guidance improves mean scTM by 0.002, while uniform-random slate selection improves by 0.0021 (with even lower ). Based on the reported mean results, ECHO-only guidance does not outperform uniform-random selection from the same legal slate. It's very weird that the whole system show competitive performance improvement. Does the ECHO collaborate well with the other modules well?
(Major) Also, say, if there are 60 targets and the average improvement is 0.0058, and I think the optimization on each targets is trivial. For the structure prediction problem, say for AlphaFold, if you simply change the random seeds, the structure prediction score will be increased somehow, and I think the increase will not be as trivial as 0.0058. Also, for the protein design problem, we often include a relatively larger benchmark so that the performance improvement will be more reliable. Of course I understand that the authors may argue that the RNA structure is scarce and no sufficient data.
(Major) A central claim is that SKETCH produces interpretable and biophysically grounded reasoning for residue edits. However, the authors later state that SKETCH is prompted with the target identifier, current sequence, step index, remaining edit budget, and legal alphabet. I wonder how the LLM directly assesses the target's structural geometry, folding defects, base-pair relationships, 3D contacts, previous verification feedback, etc. E.g.,, deciding whether an edit should resolve a steric clash or satisfy an A-minor interaction normally requires information about the structural environment. A target identifier and sequence alone do not explicitly supply this information.
(Major) On the world model formulation and its necessity for multi-step reasoning-guided editing. I am not fully convinced that ECHO functions as a world model in the proposed framework, or that its necessity has been sufficiently demonstrated. As described, ECHO mainly predicts a scalar quality change for a candidate edit, rather than the resulting RNA conformation or a complete state transition. This makes it closer to a learned edit-quality scoring function than a conventional dynamics model. While such an abstraction could still support planning, I'm confused on how ECHO enables meaningful multi-step reasoning, since the search procedure doesn't perform folding at intermediate nodes.
(Minor) Proposition 1 defines the task reward as state-quality function and used a shaped reward. The paper claims that the optimal policy under this reward is necessarily the same as under the original task reward. However, the potential depends on the reasoning trace r, but r is not included in the state definition in Section 3.1. The Markov-state assumptions behind the stated theorem probably need clarification. More importantly, GAUGE is not used only through potential-based reward shaping. Its raw energy also affects initialization, candidate ranking and acceptance. These operations can change which designs are selected, regardless of whether the shaping term preserves an optimal policy.
(Minor) Several in-consistency issues, see the questions part.
Questions for authors
- Why the table 1 shows the gRNAde trRosettaRNA scTM as 0.235, while the table 9 reports the tR score as 0.220, 0.226 and 0.206 by 3 length groups. Did I miss any splitting details?
- How did you implement the GAUGE module? You described in the manuscript as backbone/seq/text encoders + cross-attention, but your released codes only include the GAUGE as a scalar-feature MLP
EnergyGauge, atrivet_system/gauge_energy.py. In your codes , the crossattention seems to be in a separate initializer module, which doesn't establish in the GAUGE modules. I wonder, what does the GAUGE's actual implementation and contribution? Please let me know if I miss any details. - What are the full-test results for the backbone-conditioned initializer without any editing? How much do GRPO training, reasoning traces, ECHO, and GAUGE each improve performance under the same candidate and verification budget? I understand the full ablation experiments may take lots of computations, but since the existing ablation results are not convincing, I hope the authors can clarify or offer some insightful discussions.
- How does Proposition 1 handle finite-horizon termination, the task-quality difference reward, and the trace-dependent potential?
- How are the structural quality features of unverified intermediate states obtained? How does ECHO account for interactions between consecutive edits?