- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper introduces a framework to learn ribosome profiles from multiple Ribo-seq datasets, called RiboUnmix. The idea is that Ribo-seq measurements contain both biological information and experimental biases. The authors propose to separate these two components by learning a shared sequence-dependent profile and dataset-specific corrections. The model uses two bidirectional GRUs and a negative-binomial observation model. It is evaluated on synthetic data, 114 HEK-derived datasets, and four prediction benchmarks.
Critical strengths
- the paper is well written and makes the biological concepts clear also for not experts.
- the research question of the paper is interesting and clear.
- Using multiple experiments to separate shared information from dataset-specific biases is a good idea. I also like that the model learns these corrections directly from data, without requiring predefined bias features. This approach could also be useful for other biological applications.
Critical weaknesses
-
I think that the shared profile does not necessarily represent the true biological ribosome occupancy. If several datasets share the same systematic bias this bias may become part of the shared profile instead of being removed. Therefore, good reproducibility across models does not necessarily mean biological correctness. Some independent biological validation would make the results stronger.
-
Figure 13 suggests that the learned profile is already close to its reference target with few datasets. Adding more datasets seems to makes the reference target closer to the true occupancy because different biases cancel each other; so, part of the improvement may come from averaging different measurements rather than from the proposed model. A comparison with a simple consensus baseline, such as a model trained on the weighted geometric mean of normalized profiles, is important to understand better this.
-
The prediction benchmarks show good performance, but they are based on individual datasets and do not directly demonstrate the benefit of the proposed multi-dataset decomposition. Comparisons with simpler approaches, such as pooled training, averaging predictions from separate models, or learning a consensus profile, would help isolate the contribution.
-
I think that the general idea is related to existing approaches in multi-task learning, batch-effect correction, and shared representation learning. I think the main novelty is the application of this approach to Ribo-seq; for this reason, I am not sure that this paper is a good fit for this venue, since the contribution seems more focused on a specific biological application than on methodological novelty.
-
The synthetic datasets reuse the same ribosome trajectories, and observations are not fully independent.
Questions for authors
See weaknesses.
2 comments
Thank you for your response. I appreciate that you response and that you plan to add new experiments.
However, I decided to keep my original score for these reasons:
-
Missing baselines (my Weaknesses 2 and 3). I appreciate that you plan to add comparisons with arithmetic and geometric mean baselines and pooled training. However, these results are not yet provided, and I think they are important to understand the real contribution of the proposed method beyond simple averaging.
-
Synthetic data (my Weakness 5). You acknowledge the dependence between synthetic observations, but the experiments with independent trajectories and an independent test set are still missing.
-
Novelty (my Weakness 4). Your explanation helps clarify the contribution but I still have some doubts about the methodological novelty compared to existing shared representation and batch-effect correction approaches.
Several important concerns still need experimental evidence.
We thank the reviewer for a detailed and technically precise review, and for appreciating the clarity of the paper, the research question, and the idea of learning dataset-specific corrections directly from data without predefined bias features.
W1: The shared profile is not necessarily biological occupancy. We agree, and we will state this explicitly in the abstract and introduction rather than only in Appendices B.4 and H.7. This is a mathematical limitation of the problem itself rather than of the model. When the only information available is a set of datasets, a bias shared by all of them is indistinguishable from biological signal, and no method can separate the two without external information. Our goal is to reach the maximum recovery possible in this setting, where nothing is known except the availability of multiple heterogeneous datasets, and to characterize exactly what can and cannot be recovered (Appendix B). We fully agree that independent biological validation would substantially increase the value of the results, and we will add a comparison of the shared profile with known sequence-dependent pausing motifs.
W2 and W3: Contribution of the model beyond averaging, and multi-dataset comparisons. The reviewer's reading of Figure 13 is correct: the learned profile tracks its reference target closely, and recovery of the simulated profile improves as complementary biases cancel across datasets. We see this cancellation as the intended mechanism; what the model contributes is performing it from incomplete, noisy observations and generalizing it to transcripts never seen in training. We agree this must be demonstrated directly, and that the single-dataset benchmarks in Section 7 only show that the sequence encoder is a competitive predictor. We will therefore add the following baselines in both the synthetic and HEK multi-dataset experiments:
These comparisons isolate the contribution of the dataset-specific corrections from the effect of combining datasets.
W4: Relation to existing approaches and venue fit. We agree that the method shares ideas with multi-task learning, batch-effect correction and shared representation learning, and we will discuss these connections explicitly. However, disentangling a shared term from multiplicative bias terms is not identifiable in general, and RiboUnmix relies on a specific mathematical construction to make it so: fixed-reference two-way centering of the corrections, with formal identification results (Section 4.3, Appendix B). Both components are predicted from sequence and must generalize to unseen inputs. The formulation is not specific to Ribo-seq, and applies to other settings where multiple biased measurements of a shared sequence-dependent signal are available, as the reviewer also notes in the strengths.
W5: Dependence in the synthetic data. We agree (Appendices E.3 and F.1). We will extend the synthetic benchmark with independent trajectories and independent count sampling for each condition, and evaluate recovery on a held-out test set not used for checkpoint selection.
We thank the reviewer again; these comments identify precisely the analyses needed to strengthen the paper's claims.