- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates whether synthetic context can improve a frozen causal genomic language model’s RNA fitness predictions without task-specific training. The authors evaluate BasePrompt on 70 RNAGym assays using experimental variant-fitness measurements, with matched reverse-complement scoring and auxiliary DNA experiments. The results show modest improvements in aggregate variant-ranking performance.
Critical strengths
1.BasePrompt is a simple inference-time method that modestly improves agreement with experimentally measured RNA fitness without additional training.
2.Matched reverse-complement comparisons and direct-scoring controls help establish that the gains are not solely attributable to reverse-complement ensembling.
Critical weaknesses
1.The context-shortage motivation is insufficiently established. Short RNA sequences, absent genomic flanks, and insufficient context for fitness prediction are distinct issues. Table 3 includes sequences ranging from 45 to 5,592 nucleotides, and mature RNA boundaries do not necessarily indicate missing biological information. The paper does not establish which assays lack relevant context, whether that context is retrievable, or whether its absence impairs prediction.
2.Improved correlation with experimental measurements supports better benchmark ranking, but does not establish that synthetic flanks compensate for missing biological context. Although the authors appropriately acknowledge this distinction, the experiments do not adequately separate context-conditioning effects from changes introduced by scoring the synthetic bases themselves.
Questions for authors
1.Can you identify assays with genuinely missing biological context and evaluate whether gains depend on sequence length, available context, or controlled context truncation?
2.Do the improvements persist when scoring only the original RNA positions, excluding synthetic-flank likelihood terms, and when comparing against random or constant flanks on RNAGym?
3.How does BasePrompt compare with simpler alternatives, such as conservation or alignment-based scores, relevant thermodynamic scores, and sequence-feature models, with supervised methods evaluated separately under appropriate training protocols?