- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper frames RNA therapeutic design as selective inference, where each pipeline stage returns an evidence certificate and is allowed to abstain. The framing, leakage controls, and exact-fallback proof are exemplary. The problem is the empirical core, which is weak for ICLR. For example, the ranker anti-correlates with real activity out of distribution, the ranking gain is small and partly just comes from ensembling, and several "certificates" rest on data reuse the authors themselves admit violates their independence assumptions.
Overall, it reads more like a reliability framework with honest negative results than a genuine methods advance.
Critical strengths
-
Every stage of the RNA design pipeline returns an evidence certificate and is allowed to abstain instead of forcing a point call. Turning "defer" into a first-class operation is the right instinct for a noisy, high-cost domain.
-
Frozen SHA-256 manifests, machine-checkable leakage audits, and a real exact-fallback proof. The constrained-decoding result is concrete too. Chemistry-validity jumps to 100% across all three modalities with novelty preserved.
Critical weaknesses
-
The learned ranker is the headline but it falls apart out of distribution. This paper claims that rank correlation with true activity goes negative on every external set, often worse than plain GC content. For a "ranker" contribution, that's the main event, not a footnote.
-
The +0.110 over OligoAI only shows up when you stack on the baseline you're comparing against, and a capacity-matched control basically matches it. Algorithmic novelty is light. For example, the stats are all classical and the authors themselves call KRAIG-SR "a simple diagnostic baseline."
-
The independence premises rely on weights/scores/grid that reuse the dev families, and the agreement stat was inspected after seeing outcomes.
-
Power is also low (five seeds, sign-test p=0.0625, Holm 0.44).
Questions for authors
please see Weakness section.