- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors introduce DTFlow for generation and prediction of RNA base-pair matrices (BPMs). Recognizing the importance of modeling RNA's multi-state conformations, the DTFlow architecture prioritizes BPM representation learning through its dual RNA sequence-pair representation channels. Empirical results suggest that DTFlow is modestly competitive for RNA BPM prediction across different biological contexts.
Critical strengths
- The authors identify the importance of modeling RNA BPMs for multi-state RNA conformation prediction.
- DTFlow borrows useful ideas from the protein structure prediction literature for robust RNA modeling, including pair-bias attention.
- DTFlow is evaluated comprehensively for RNA BPM prediction.
Critical weaknesses
- Although the use of large language models (LLMs) is certainly not prohibited in preparing ICLR manuscripts, my reading of this paper suggests that the authors heavily relied on LLMs for code development, experiment design, and manuscript writing, resulting in a very dense 9-page block of main text that I found difficult to parse. I would have liked to see the authors take the time not to use verbatim LLM text in their submitted manuscript, as I believe this would have greatly improved the readability of the manuscript. As two examples of (what I believe to be) vague LLM writing in the main text, Lines 86-88 ("Evaluation measures reference coverage and candidate fidelity at explicit candidate counts: how closely the candidate set reaches each reference, and each candidate matches an observed BPM") and Lines 278-279 ("Split construction excludes target-related sequence groups using sequence, structural and fragment-reuse links") are practically unreadable to me.
- Given that the authors have (presumably) relied heavily on LLMs to submit this manuscript, for me, it calls into question what I'm supposed to take away from this work, given that DTFlow's results across different benchmarking contexts (e.g., Table 1 - "single", "inter", "CASP15", and "CASP16" columns) are mixed compared to "Thermodynamic" baselines and that this manuscript is difficult to read in the first place.
- Lastly, given that DTFlow seems to offer modest performance advantages in a small number of RNA-specific contexts without being described clearly, I find it difficult to draw any notable insights from reading this work, such as compelling representation learning or generative modeling ideas to consider in future work on AI for biology.
Questions for authors
- Why do the authors use 1x1 convolutions instead of making DTFlow entirely based on attention? If the authors had used attention only, then they might have been able to leverage optimized CUDA kernels to accelerate training and inference (e.g.,
cuEquivariance). The rationale for choosing 1x1 convolutions was not clear to me in this light. - Would the authors please consider replacing the term "trails" with another verb, since its usage throughout the manuscript confused me quite a bit (e.g., does it carry a positive or negative connotation in all contexts here)?