- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
- The paper details the development of TAPER, which can be used to predict circRNA-miRNA interactions. Although other predictors exist, TAPER achieves the highest reported AUC, AUPR, and ACC. Additionally, TAPER takes a multi-step approach with task-conditioned graph construction, degree-conditioned residual decomposition, global prediction, marginal-constrained local refinement, and local to global refinement. Of these steps, the ablation of dual-graph residual decomposition was found to have the largest effect on accuracy.
Critical strengths
-
Method description behind the development of TAPER, including the equations used for the construction of the graphs and the prediction, in much detail.
-
Highly relevant problem in biology, finding regulatory post-transcriptional interactions between circRNA and miRNA has great potential for identifying novel elements driving disease and cellular states in general
Critical weaknesses
-
One of the weaknesses of the paper is that, although it is briefly mentioned that circRNA-miRNA interactions regulate gene expression, the further real-world significance and relevance of TAPER is not explicitly expanded upon.
-
Not clear why they did not use a circRNA database for testing and reporting plots AUROC/AUPR over full graphs. This was partly done in the supplement, so please consider moving it to main text and consider a test data set unseen by the model. Also, the AUC of 0.97 over the full set of interactions may indicate a leakage, potentially through a degree bias in the graph. A degree-preserving control has to be done for faithful comparison.
-
Incremental contributions over ML architecture, especially considering recent advances such as a graph attention etc.
-
Although the data on which the model was evaluated is specified, the data on which the model was trained is not explicitly mentioned in the paper.
Questions for authors
-
Is it possible to do graph prediction conditional on a cell type/state? The concern here is that these interactions are context-specific.
-
It seems that sequence basically drives these interactions. Structure is predicted from sequence, so wouldn’t a sequence-only predictor help learn accurate graphs. It would be interesting for example to report the co-folding scores between cirRNA and miRNA as a baseline.
8 comments
Response to W2: Full-Graph Evaluation, Data Leakage, and Degree Bias
Thank you for highlighting the need for database-based testing, evaluation over the full candidate graph, and controls for degree effects. Our benchmarks include database-derived circRNA–miRNA records. In particular, CMI-9589 is obtained from circBank, as described in Section 5.1. We will make this provenance more explicit and move the full candidate pool evaluation from Appendix Table 13 into the main experimental section. We will also add the corresponding ROC and precision-recall curves and specify the candidate pool composition.
Table R1. TAPER performance under balanced and full candidate pool evaluation on CMI-9905.
| Evaluation setting | AUROC | AUPR |
|---|---|---|
| Balanced evaluation, positive-to-unlabeled ratio of 1:1 | 0.9721±0.0023 | 0.9794±0.0014 |
| Full eligible unlabeled test pool | 0.9710±0.0025 | 0.7102±0.0089 |
We added cross-dataset testing using models trained on CMI-9905 and evaluated on additional CMI-20208 interactions. Biological identifier matching established 841 shared miRNAs and 2,113 shared circRNAs. After removing 9,342 overlapping interactions, we retained 7,320 additional positive interactions among these shared RNAs and evaluated them with 8,784 eligible unlabeled pairs. The external test pair identities were reserved before source fitting and excluded from source training supervision. Each source model was fixed before external scoring.
The five source fold models achieve an external AUROC of 0.8993 ± 0.0035 and an AUPR of 0.8975 ± 0.0023. Table R2 provides the detailed results. This experiment assesses prediction of additional interaction labels in a separate benchmark among RNA entities shared with the source dataset.
Table R2. Cross-dataset evaluation of TAPER trained on CMI-9905 and tested on nonoverlapping CMI-20208 interactions among shared RNAs.
| Fold | ACC(%) | SEN(%) | SPE(%) | PRE(%) | MCC(%) | AUC | AUPR |
|---|---|---|---|---|---|---|---|
| Fold 1 | 80.44 | 62.12 | 95.71 | 92.34 | 62.49 | 0.9038 | 0.8996 |
| Fold 2 | 77.11 | 51.98 | 98.05 | 95.70 | 57.78 | 0.8953 | 0.8958 |
| Fold 3 | 80.61 | 63.02 | 95.28 | 91.75 | 62.64 | 0.8984 | 0.8971 |
| Fold 4 | 79.77 | 59.74 | 96.46 | 93.36 | 61.62 | 0.9020 | 0.9001 |
| Fold 5 | 79.80 | 60.86 | 95.58 | 91.99 | 61.29 | 0.8970 | 0.8951 |
| Mean ± SD | 79.55±1.41 | 59.54±4.41 | 96.22±1.12 | 93.03±1.62 | 61.16±1.98 | 0.8993±0.0035 | 0.8975±0.0023 |
All five source models are evaluated on the same fixed external test set. Classification thresholds are selected exclusively using CMI-9905 validation data. The summary describes variation across the five source models.
We further conducted a controlled assessment of degree effects on CMI-9905 using identical five-fold partitions and evaluation pairs. The degree-only predictor uses the probabilities , fitted exclusively from the training-positive graph. For the degree-preserving control, bipartite edge swaps change interaction partners while preserving the training degree of every circRNA and miRNA. Validation and test pairs remain fixed and are excluded from the admissible swaps. All association-dependent quantities are rebuilt from the rewired training graph. Biological similarity inputs, model architecture, and training hyperparameters are retained.
Table R3. Controlled assessment of degree effects on CMI-9905.
| Condition | AUROC | AUPR |
|---|---|---|
| Degree-only predictor | 0.8157±0.0055 | 0.8361±0.0043 |
| TAPER with degree-preserving rewired training graphs | 0.8528±0.0032 | 0.8541±0.0013 |
| TAPER | 0.9721±0.0023 | 0.9794±0.0014 |
For the rewired condition, ten repetitions are averaged within each fold before calculating statistics across folds. All fifty runs reached the prescribed swap target.
The degree-only result shows that endpoint degree carries predictive information in this benchmark. Preserving those degrees while changing interaction partners decreases TAPER’s AUROC by 0.1193 and AUPR by 0.1253. This comparison supports a contribution from the observed interaction structure beyond the information retained by node degrees.
To address the leakage concern, test pairs are excluded from supervised training. Every computation that depends on interaction labels uses only the current training partition. Model checkpoints, the global evidence scale, and classification thresholds are selected using validation data. Test interaction labels are reserved for final evaluation. In the cross-dataset experiment, target labels are excluded from feature construction, fitting, and model selection.
We will state this information separation explicitly in the revised manuscript. The appendix will provide the individual fold records and document overlap removal and degree-preservation checks.
Response to W3: Architectural Novelty Beyond Graph Attention Methods
Thank you for highlighting the need to position TAPER in relation to recent advances in graph attention. We recognize that these methods already provide substantial modeling capabilities. GATv2 supports query-dependent attention, and Graphormer incorporates degree and structural information into graph representations. Recent circRNA-miRNA predictors also combine information at different scales.
TAPER contributes a specific relationship between connectivity information and the evidence used for prediction. In Graphormer, degree information enters the representation through centrality encodings. In TAPER, degrees define a reference interaction probability against which observed interactions are evaluated. The resulting residual expresses how a pair departs from the connectivity expected for its endpoints. This gives degree information a statistical role in defining the prediction signal. The biological graphs, constructed from measured interaction-recovery utilities, determine how this residual evidence is organized.
TAPER also specifies how global and local evidence should interact at the prediction level. The residual decomposition assigns the graph-smooth component to global prediction and the remaining component to local refinement. The global predictor then establishes the marginal probability budgets that constrain the local update. Under the projection objective, increasing one candidate’s probability requires compensating adjustments among other candidates sharing its endpoints. This makes local refinement a coordinated allocation of probability across possible partners. The contribution is the explicit coupling between the residual decomposition and the constrained prediction objective, which gives global and local evidence defined responsibilities.
We will revise the Introduction and Related Work to discuss these recent attention-based approaches and make this contribution more precise. We will acknowledge the established foundations of adaptive weighting and graph regularization, and explain how TAPER uses them within its degree-referenced, marginal-constrained formulation. This will clarify the modeling assumptions introduced by TAPER and their relevance alongside advances in attention-based representation learning.
We sincerely thank you for your careful review and for recognizing TAPER's detailed methodology and biological relevance. We value your constructive feedback. We added full-pool and cross-dataset evaluations, degree-preserving controls, an RNAcofold baseline, and cell-background analyses, while clarifying training data, novelty, and practical significance. We address each concern below. If these responses resolve your concerns, we would be grateful if you would reconsider your assessment. Thank you again.
Response to W1: Biological Significance and Practical Relevance of TAPER
Thank you for highlighting this gap in the presentation. We agree that the manuscript should explain more explicitly how circRNA-miRNA interactions affect downstream gene regulation and why identifying these interactions is useful in biological research. TAPER is intended to help researchers select candidate interactions for experimental investigation and develop testable hypotheses about the functions of circRNAs.
MiRNAs regulate gene expression by binding to target mRNAs and promoting their degradation or repressing their translation. Some circRNAs bind miRNAs and function as molecular sponges. Under conditions that permit competition for miRNA binding, a circRNA can reduce miRNA activity toward its target transcripts, thereby relieving repression and changing the expression of downstream genes. The extent of this effect depends on the abundance of the interacting RNAs and the availability of binding sites. Identifying the relevant circRNA-miRNA pair therefore provides a possible mechanistic connection between a change in circRNA expression and a change in cellular function.
TAPER’s practical role is to help identify which candidate relationships deserve experimental attention. For example, a researcher may observe that a circRNA is expressed differently between treatment-sensitive and treatment-resistant cells, while the miRNA partners responsible for its possible regulatory effects remain unknown. TAPER provides a ranked list of candidate partners within the available RNA set. Researchers can examine these predictions alongside expression measurements from their experimental system and select pairs for direct binding assays. This gives the model’s output a concrete use in deciding which interactions to investigate when the number of possible pairs exceeds the available experimental capacity.
The predicted pairs can also guide the development of more specific mechanistic hypotheses. By combining a candidate circRNA-miRNA interaction with independently supported miRNA-mRNA target relationships, researchers can nominate downstream genes whose expression might respond to circRNA perturbation. They can then test whether manipulating the predicted miRNA reverses the observed effect of altering the circRNA. Such experiments examine whether the proposed interaction mediates the biological response. In studies of cancer or treatment resistance, this workflow can help identify a regulatory relationship through which an RNA affects cell proliferation or drug sensitivity. Establishing that relationship provides a basis for subsequent studies of whether manipulating the pathway changes the disease-related phenotype.
Our case studies illustrate these connections. Among the 20 highest-ranked predictions, 19 have supporting publications in Table 3. Published experiments linked hsa_circ_0004771 and miR-339-5p to CDC25A regulation and esophageal squamous cell carcinoma progression. The hsa_circ_0025202 and miR-182-5p interaction was linked to FOXO3a regulation and tamoxifen sensitivity in breast cancer. These examples connect predicted interactions to experimentally studied mechanisms with relevance to disease progression and treatment response.
In the revised manuscript, we will expand the Introduction to explain the regulatory connection from circRNA binding to downstream gene expression. We will also describe how TAPER’s ranked predictions can inform candidate selection and the formulation of mechanistic hypotheses. Section 5.5 will be revised to connect the representative predictions to their reported biological functions, with a concise explanation of their relevance to experimental follow-up. We will clarify that the functional consequences of a newly predicted interaction require validation in the relevant biological context.