- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This manuscript evaluates the biological grounding and faithfulness of attribution methods applied to RNA foundation models. It compares six conventional attribution methods and AttnLRP across six fine-tuned models and six RNA tasks, using exhaustive single-nucleotide in silico mutagenesis (ISM) as a model-response reference. Attribution and ISM maps are assessed against shared biological annotations and sequence-blind positional baselines, while comprehensiveness and sufficiency are measured on real and dinucleotide-shuffled sequences. The authors report that ISM exceeds the positional baseline on four tasks, whereas conventional attribution methods generally recover less annotated signal and exhibit substantial variation across models. Additional experiments examine the recovery of designed RNA base pairs, comparisons with models trained from scratch, and implementation-specific failures of DeepLIFT. The comparison against each model’s own perturbation responses provides a useful basis for evaluating attribution results, although the broader observation that predictive performance does not guarantee reliable explanations is already established in previous research. Overall, the manuscript presents an RNA-focused empirical evaluation with limited conceptual novelty, whose significance depends on the reliability and practical value of its additional findings.
Critical strengths
Evaluation against model responses and biological annotations
The manuscript compares attribution maps with the same model’s ISM responses against shared biological annotations, allowing poor attribution grounding to be examined alongside evidence of mutation-sensitive model responses. The positional baseline is also a useful control for annotations that can be recovered from their location without sequence-dependent information.
Assessment of structural relationships
The chemical-reactivity experiments extend the evaluation beyond motif localization by examining whether cross-position response maps recover designed RNA base pairs. Matching non-paired controls by distance and partner nucleotide strengthens this comparison by controlling for simple proximity and nucleotide-identity effects.
Concrete implementation diagnostics
Appendix D investigates why the tested DeepLIFT implementations produce results nearly identical to Saliency on five of the six models. The connection between missing propagation rules and attribution outputs provides an actionable diagnostic for researchers applying existing interpretation tools to RNA encoders.
Critical weaknesses
Limited conceptual novelty and insufficiently articulated additional insight
The central concern about the reliability of model explanations has substantial precedent, including Attention is not Explanation (Jain and Wallace, 2019) and Sanity Checks for Saliency Maps (Adebayo et al., 2018). More directly relevant to this manuscript, Majdandzic et al. (2022) demonstrated that genomic models with strong predictive performance can yield substantially different attribution quality, showing that predictive accuracy alone does not guarantee reliable interpretation. Majdandzic et al. (2023) subsequently identified off-simplex gradient noise in one-hot genomic inputs and introduced the correction adopted in this manuscript. Tang et al. (2025) also reported diffuse attribution maps and disagreement across pretrained genomic language models, although their attribution analysis used frozen language models and downstream CNNs. These studies do not establish all of the manuscript’s specific findings for fine-tuned RNA models, but they provide direct precedents for several of its central observations. The manuscript acknowledges this literature, yet should more clearly identify which findings from the ISM-referenced comparisons and CRP experiments extend existing knowledge and explain their practical or scientific significance. As currently presented, the main conclusions largely reinforce established concerns, while the additional insight provided by the RNA-specific empirical extension remains insufficiently clear.
Inconsistent definitions of positional attribution scores
Section 2.1 and Appendix G describe positional scores obtained by gauge-centering the attribution map and selecting the observed nucleotide channel. However, Appendix F specifies channel summation for Integrated Gradients and GradientSHAP, with task-dependent exceptions, while Table 9 retains an earlier positional score for all ten models. These reductions are not mathematically interchangeable and can change position rankings, affecting both biological grounding and deletion-based faithfulness. Because comparative attribution performance is central to the manuscript, the authors should specify the exact reduction underlying each result, justify the exceptions, and recompute affected tables using consistent, method-appropriate formulations. The sensitivity of the PAS results and the comparisons in Table 9 to these choices is particularly relevant.
Questions for authors
Which specific findings from the ISM-referenced evaluation and CRP experiments provide additional insight beyond existing genomic attribution studies?
Could you clarify how these findings change the interpretation or use of attribution methods for RNA foundation models?
3 comments
Thank you to the authors for their detailed rebuttal. The corrections and additional analyses address my methodological concerns, and I now consider the manuscript methodologically sound.
However, my assessment of its contribution remains unchanged. Given the limitations of current RNA foundation models and the established concerns about attribution reliability discussed in my original review, I find the main conclusions largely unsurprising. The manuscript provides further empirical evidence using existing evaluation techniques, but the rebuttal does not convince me that the RNA-specific findings offer substantial additional scientific or practical insight. The additional analyses strengthen the evidence for the reported phenomena without substantially changing my assessment of their novelty or significance. Overall, while my methodological concerns have been addressed, I continue to find the manuscript’s contribution limited.
Respnose to Reviewer YUiE
Thank you for confirming that the methodological concerns have been addressed. We appreciate your clarification that the remaining concern is the significance of the contribution. We agree that attribution unreliability is established. We would like to clarify two practical findings that our previous response to you did not make explicit.
-
First, we identify an actionable implementation failure and test an intervention. In the evaluated implementations, DeepLIFT applies no propagation rule to relevant custom activations or function calls in five of the six RNA models, producing Saliency-equivalent maps. Applying the missing activation rescale rule increases median comprehensiveness from 0.57 to 0.81, with improvements in 24 of 30 checkpoint–task settings (Appendix D.1). This gives practitioners a specific failure to check and evidence about the effect of correcting it. Completeness remains unsatisfied, so we do not claim a general DeepLIFT repair or that this improvement establishes biological grounding.
-
Second, we test how practitioners can select an attribution method under a limited ISM budget. Separately for each of 36 checkpoint–task combinations, we select a method using 50 sequences and evaluate its agreement with full ISM on disjoint held-out data, repeating the procedure 500 times. CRP splits hold out whole target structures. The selected method is the held-out best by ISM agreement in a median 96.3% of draws across combinations (range 40.6–100%; Section 4.4, Appendix N). This supports a measured starting budget, with explicit limitations, for checkpoint-specific method selection. It does not certify biological correctness, which requires a separate annotation-based evaluation.
These practical results complement the structural finding discussed previously. For RNA-FM fine-tuned on chemical reactivity without base-pair targets, Saliency gives near-chance pair recovery (AUROC 0.495), while the same checkpoint yields 0.719 with ISM and 0.816 with AttnLRP on the same evaluation. Thus, limitations of the underlying model cannot by themselves explain the failed Saliency map. The practical consequence is to check the explanation method before using that map to dismiss structural sensitivity in the model’s predictions.
We recognise that these are empirical contributions built using existing techniques. Their value lies in identifying a specific implementation failure, testing an intervention, and evaluating an affordable method-selection procedure alongside the RNA structural analysis. We would appreciate reconsideration of the manuscript’s practical significance on this more specific basis.
We thank the reviewer for their time and their astute observations
W1/Q1/Q2: Added insight
We agree that attribution unreliability is established. Our additional finding concerns base-pair relationships in a fixed RNA model’s predictions: its substitution responses recovered designed pairs, while several conventional methods remained near chance. On RNA-FM, fine-tuned to predict chemical reactivity without base-pair targets, Saliency and DeepLIFT scored 0.495 and Input × Gradient 0.517 for base-pair recovery (AUROC), while the same model’s ISM responses scored 0.719 and AttnLRP 0.816 (submitted Table 14; Table 19 in the revised paper), with the checkpoint, annotated pairs and matched non-pairs held fixed.
The additional insight is that several conventional methods can miss pairing-related dependencies expressed in the same model’s predictions. This identifies an attribution failure that could otherwise be mistaken for an absence of structural sensitivity. Practitioners should therefore validate an uninformative structural map against the same model’s substitution responses and annotations. ISM is a reference, not an upper bound.
The ISM-referenced evaluation adds a second finding. Across the four tasks on which ISM exceeds the positional floor, the attribution methods recover a median 60% of the same model’s ISM grounding and 10% of its gain over the floor, so low grounding cannot be explained solely by an absence of model response to the annotated signal.
Action: We have clarified this contribution and its practical consequences in the Introduction, Related Work and Sections 4.3 and 5.
W2: Position scores
We thank the reviewer for identifying this inconsistency. The revised paper states one rule (Section 3.1, submitted Section 2.1; Appendices C, F and G) and applies it in every analysis, so no task-dependent exception remains:
Submitted IG/GradientSHAP results retained the earlier centred observed-base score in submitted Tables 2/3/9 (Tables 4/7/14 in the revised paper), SPL/m6A, CRP faithfulness and seed-0 PAS IG grounding. Other main BBP/MRL/PAS results used raw sums. GradientSHAP gradient centring was already present in those main analyses and in the CRP pair maps, but not in the named tables. We recomputed the affected results using the original checkpoints.
Table R2. PAS IG grounding (AUPRC) on the 197 annotated sequences of the 400-sequence draw; the positional floor is 0.138.
The median changes 0.082 → 0.075; SpliceBERT remains the sole above-floor point estimate. Recomputation changes GPU platform and OmniGenome’s IG steps 32 → 64 (others retain 32).
Across 168 combinations (BBP/MRL/PAS/CRP), median grounding/ISM remains 60%; the median share of ISM’s gain above the floor changes 11% → 10% (10.604% → 10.272%); and 59/168 remain at or below the floor. Paired grounding tests against matched ISM remain significant (Holm p ≤ 2.5×10⁻⁵).
Submitted Table 9 (Table 14):
Action: We have clarified the scoring rules, removed the exceptions and recomputed the affected comparisons, with headline intervals in Appendix A and sensitivity analyses in Appendix F.1.