- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes a two-stage framework, RNA-IFlow and RNA-IFlow-RL, that combines structural conditional Dirichlet Flow Matching with reinforcement learning for RNA inverse folding design. The method achieves thermodynamic feedback-based sequence optimization through finite strategy mapping and structural constraints.
Critical strengths
-
The method is somewhat innovative. By transforming continuous flow matching into a finite reinforcement learning strategy and introducing a pair-preservation constraint, it provides a new technical framework for RNA sequence optimization.
-
The method demonstrates good performance and efficiency. It outperforms existing methods on multiple benchmarks, and its number of parameters and inference time are significantly lower than those of RNA-Design-LM.
Critical weaknesses
-
The effectiveness of Flow-to-Policy Mapping has not yet been fully demonstrated. Table 10 in the appendix shows that finite policies not optimized via RL perform significantly worse than the original Flow model, indicating that the mapping itself fails to effectively preserve generative performance.
-
The improvement over the strongest baseline is limited. For example, the Pass@8 score for Eterna100-v2 increased only from 63.67% to 65.00%, and further evidence is needed to demonstrate the statistical significance of this improvement.
Questions for authors
- Why does Flow-to-Policy Mapping significantly reduce initial generation performance?
- Can authors provide a comparison with other reinforcement learning methods using the same backbone network and training budget to demonstrate the independent contribution of limited policy design?
I will raise my score if authors can anwser my questions clearly.
3 comments
Thanks for your response. But I did not see the "follow-up comparison"?
Response to Reviewer 5Eh8
Thank you for checking. The follow-up comparison has not been completed. The controlled comparison with other reinforcement-learning formulations on the same backbone and budget remains planned work: it requires adapting each formulation to the continuous Dirichlet predictor and re-running post-training from the same supervised checkpoint, which we could not complete within the discussion period.
Table 4 lists what the current results contain. Tables 11 and 12 vary the hyperparameters of our own method; none of them isolates the policy design from the RL algorithm, and the revised paper will state this limitation explicitly.
Table 4. P@8 on Eterna100-v2 (Table 10 of the submission).
| Setting | P@8 (%) |
|---|---|
| Native flow | 52.00 |
| Finite policy, no RL | 24.33 |
| Finite policy + RL (RNA-IFlow-RL) | 65.00 |
Response to Reviewer 5Eh8
Thank you for recognizing the framework and the efficiency results, and for asking about the mechanism and the controls.
W1 and Q1 — Mapping rationale and initial performance loss. FPM converts the continuous Dirichlet predictor into a finite policy whose transition probabilities RL can evaluate explicitly. Conditional-mean inputs reuse the predictor, and normalized keep-or-resample kernels define actions over structural units. Shorter inference is a secondary benefit.
The conversion changes initialization, inputs, and dynamics together, so the exact conditional mean does not guarantee that the native sampling distribution is preserved. A nonlinear predictor evaluated at a mean need not equal the average of its predictions over random inputs. P@8 falls from 52.00% for native flow to 24.33% for the finite policy, then reaches 65.00% after RL. This shows effective post-training alongside an initial conversion cost.
W2 — Significance and practical value. On Eterna100-v2, P@8 rises numerically from 63.67% to 65.00%. The practical contribution also includes the smaller model and faster measured generation: 87.55M versus 357.92M parameters, and median resident-model K=8 generation of 0.73s versus 4.41s. These support a favorable quality–cost trade-off under the reported protocol.
Q2 — Matched RL comparison. This control has not been completed. RNA-Design-LM differs in backbone, capacity, and generation procedure, and Tables 11–12 vary our own hyperparameters. Following your suggestion, the follow-up comparison will start from the same supervised checkpoint and fix targets, success criteria, rollout and optimization budgets, checkpoint selection, and evaluation.