- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RiboCTE, a framework for learning composable chemical transformation operators to predict nanopore responses for RNA modifications with limited supervision. The method learns shared transformation operators from molecular precursor–product relations and chemical paths, and transfers them to sequence-conditioned representations for downstream response prediction. The authors also introduce RiboModBench, which evaluates cross-modification generalization, chemical-action composition, few-shot adaptation, and external transfer. Experiments on ONT and Curlcake datasets show that RiboCTE achieves higher Spearman correlations than the compared baselines, particularly under modification and sequence-context distribution shifts.
Critical strengths
Modeling RNA modifications through shared chemical transformation operators is well motivated. Exploiting recurring chemical transformations across different nucleoside substrates provides a meaningful inductive bias for transferring knowledge to modifications with limited response labels.
Critical weaknesses
-
All eight RNA modifications in the main response prediction benchmark involve only single-step chemical transformations (Appendix B, Table 6). Multi-step composition is evaluated separately through molecular embedding retrieval in Track B, rather than downstream nanopore response prediction. Furthermore, Table 2 shows that the action-conditioned MLP achieves an MRR of 0.962 on edge-unseen composition, compared with 0.981 for RiboCTE, while both methods achieve an MRR of 1.000 on edge-seen composition. It remains unclear whether the learned compositional operators provide benefits for downstream response prediction beyond those obtained from modeling individual chemical transformations.
-
In Appendix G (Table 7), permuting the learned action offsets while preserving their original norms still achieves Spearman correlations of 0.204 under LOMO and 0.149 under Double-OOD, compared with 0.216 and 0.184 for the original RiboCTE model. The relatively small performance difference under LOMO raises questions about how much of the improvement comes from the specific learned chemical action assignments rather than the shared architecture or other chemical information. Moreover, the experiment uses only one permutation without reporting variability across different random assignments, making it difficult to assess the robustness of this result.
Questions for authors
-
Table 2 evaluates multi-step chemical composition through molecular embedding retrieval, while the main downstream response prediction benchmark involves only single-step transformations (Appendix B, Table 6). Could the authors clarify whether the learned compositional operators provide additional benefits for downstream nanopore response prediction? Is there any evidence that the method generalizes to response prediction involving multi-step chemical modifications?
-
Table 3 shows that removing path supervision reduces the Spearman correlation from 0.216 to 0.063 under LOMO and from 0.184 to 0.055 under Double-OOD. Could the authors explain why path supervision has such a large impact on single-step response prediction? How can this improvement be distinguished from the general benefits of additional chemical supervision rather than compositional learning itself?
-
In Appendix G (Table 7), permuting the learned action offsets still achieves Spearman correlations of 0.204 under LOMO and 0.149 under Double-OOD, compared with 0.216 and 0.184 for the original model. Could the authors clarify how much of the improvement comes from the specific chemical action assignments? Are the reported differences consistent across multiple random permutations?
3 comments
W2 & Q3: Action assignments and repeated permutations
The norm-preserving permutation retains the learned subspace, canonical-parent coordinates, cross-substrate action sharing, and each receiving action's original magnitude. The response decoder is then refitted. A consistent action code can still be used across substrates, so useful performance after permutation is compatible with the sharing mechanism. The experiment measures the additional contribution of the native action-direction correspondence.
We repeat the original control over 10 independent random assignments chosen without using response labels, each using the same three response-training seeds and folds. Each assignment permutes offsets across all 41 chemical actions. For each assignment, scores are first averaged over training seeds; the permuted entries below report the mean ± SD across assignments.
Response-exposure group LOMO: native LOMO: permuted Double-OOD: native Double-OOD: permuted Four 2′-O-methylated targets 0.280 0.201 ± 0.106 0.240 0.199 ± 0.085 I, , m5C, and m6A 0.153 0.000 ± 0.140 0.128 -0.007 ± 0.144 All eight targets 0.216 0.101 ± 0.107 0.184 0.096 ± 0.094 Native offsets outperform the permuted control in 90% of assignments under LOMO and 70% under Double-OOD.
The native assignment improves over the permutation mean by 0.115 under LOMO and 0.088 under Double-OOD, and exceeds most sampled assignments. Chemically aligned directions therefore provide additional predictive value beyond the sharing, subspace, and magnitude information retained by the control. The original single-assignment results, 0.204 and 0.149, remain part of the reported evidence; the repeated comparison places that draw alongside the wider assignment variability.
The group rows further distinguish transfer with and without same-action source response support. Together with the response-trained-vector comparison and exposure-matched replay, this analysis provides complementary evidence for the contributions of action sharing, native chemical alignment, and joint path constraints to response transfer.
The direct downstream multi-step evidence is the external m1Ψ case; Track B separately evaluates chemical-action transfer and composition.
Dear Reviewer ebis,
Thank you again for your time and thoughtful review. As the discussion closes tomorrow, November 18 (AoE), we would appreciate hearing whether our rebuttal addresses your concerns. We would be happy to clarify any remaining points before the deadline.
Best, The authors
Dear Reviewer ebis,
Thank you for focusing on the connection between composition, chemical supervision, and downstream transfer!
W1 & Q1: Multi-step composition and downstream response prediction
W1 & Q2: Path supervision versus additional chemical supervision