- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper examines whether single-cell foundation models use biologically meaningful signals for downstream predictions. This is an important topic. Using LRP, the authors analyze marker-gene relevance in C2S and scGPT classifiers and apply symbolic explanations to investigate contextual contributions of shared markers. Furthermore, a synthetic scGPT+STATE perturbation study compares attribution signatures with known regulatory relationships, differential expression, and input-ablation baselines. The findings support attribution as a diagnostic tool, while showing that apparent biological alignment depends strongly on reference selection and null models, particularly controls preserving regulatory-network degree.
Critical strengths
- The paper connects scFM downstream predictions to input genes across multiple pretrained models and two tissues. Comparisons with alternative attribution methods and input ablations provide useful support for the selected explanations.
- The degree-preserving GRN controls reveal that successful sparse-prior recovery need not identify genuine regulatory relationships. This is a valuable methodological trial for evaluating biological interpretability.
Critical weaknesses
- The biological meaning of the attribution quantities is insufficiently established. Control-expression relevance, intervention effects in a latent system, and predictions of normalized expression represent different quantities. Similarly, filtering symbolic relevance terms does not by itself establish what the model would predict after removing contextual genes.
- The incremental diagnostic value and scope remain limited. Perturbation LRP largely tracks predicted DE and perturbation ablation (Fig. H.1). The perturbation study also uses synthetic pretraining with both contexts and all perturbation identities represented during training, leaving the contributions of pretrained representations and supervised task learning insufficiently separated.
Questions for authors
- The cell-type analysis reports marker recovery, expression-rank effects, and contextual relevance across Cell2Sentence and scGPT. The connection between these observations and the biological interpretation of model behavior remains unclear. What is the principal biological conclusion established by this analysis beyond recovering known cell-type markers?
- Given the focus on Cell2Sentence and scGPT, what evidence supports extending these conclusions to other single-cell foundation models, such as Geneformer, and which claims should remain restricted to the evaluated configurations?
- The synthetic regulatory effects are defined in a latent dynamical system, whereas the predicted expression values reflect nonlinear count generation and library-size normalization. These transformations can change response magnitudes and rankings across genes. What evidence supports using the latent regulatory effects as the reference for evaluating attributions of normalized expression?
- The paper primarily demonstrates the framework’s effectiveness through aggregate statistical results, leaving its practical value for biological interpretation insufficiently illustrated. The authors should provide concrete biological cases demonstrating how the attribution results support a biologically meaningful interpretation of a model prediction.
W1: Biological meaning of attribution quantities
We agree that these quantities capture distinct aspects of the system. Control-expression relevance measures contribution to predicted expression, and should not be treated as an intervention effect. Perturbation relevance attributes the prediction to the explicit perturbation input. We compare these attribution signatures with latent regulatory references as alignment diagnostics, not as equivalent biological quantities. The relationship between latent effects and observed expression is addressed in point Q3 below. We will clarify the interpretation of each quantity in the manuscript.
W1: Symbolic XAI
We agree that filtering relevance terms is not equivalent to explicitly removing genes from the input. The value of our Symbolic XAI analysis lies in distinguishing relevance confined to shared markers from relevance arising through their interactions with other genes, without modifying the original input and potentially introducing distribution shifts. This allows us to investigate how the model exploits shared markers in different cellular contexts rather than predict what would happen if other genes were removed. We have clarified this distinction in the revised manuscript.
W2: Diagnostic value and scope
While perturbation LRP shows agreement with predicted DE and perturbation ablation, our learning-progression analysis (Fig. 6A) demonstrates its complementary diagnostic value. Specifically, at epoch 5, perturbation LRP already shows regulatory alignment beyond random-model controls, whereas predicted DE remains indistinguishable from these controls. This suggests that attribution can provide an early alignment diagnostic to supplement output-level statistics.
We also evaluate both a fully random model and a pretrained scGPT backbone with an untrained STATE head. Since scGPT remains frozen during the first five fine-tuning epochs, the epoch-5 results support the emergence of regulatory alignment (beyond random-model controls) through supervised training of STATE on fixed pretrained representations. While these experiments do not fully disentangle the contributions of pretraining and fine-tuning, they help characterise how regulatory information emerges during training.
The added OOD analysis further shows approximately stable training-GRN alignment in perturbation-LRP despite declining predicted-DE alignment with that same GRN, illustrating complementary views of model generalisation.
Q1: Biological interpretation of model behaviour
Beyond marker recovery, our findings suggest that models distinguish closely-related cell subtypes by using shared marker genes in combination with the surrounding cellular context. Expression-rank dependence and weaker marker alignment in incorrect predictions further qualify the biological interpretation of these attributions. These analyses reveal how models exploit the biological information available in their input features and highlight potential failure modes not apparent from predictive performance alone. Thus, our principal contribution is to demonstrate how attribution-based diagnostics can assess the biological plausibility of model behaviour and inform model development, rather than uncover new biological relationships.
Q2: Generalisation of the findings to other scFMs
As with other interpretability studies, our goal is to characterise the behaviour of the specific models under investigation, rather than establish universal properties. While our study covers two distinct scFM architectures, with multiple pretrained backbones, model sizes, and context configurations, we do not claim that the observed attribution patterns generalise to all scFMs. The proposed analysis protocols can be applied to other architectures such as Geneformer, provided that suitable attribution methods are implemented and validated. Accordingly, our empirical findings regarding marker recovery, expression-rank effects, and contextual relevance remain specific to the evaluated configurations.
Q3: Use of latent reference
Our empirical-DE baseline signature is computed from normalised expression. Figures 5B–C shows precisely its strong agreement with the latent direct-response signs and stationary-effect rankings, empirically supporting these references after count generation and normalisation. This does not imply preservation of effect magnitudes or exact rankings.
Q4: Concrete biological cases
For example, in the CM CD4 versus EM CD4 comparison for C2S (Fig. 4), relevance confined to the shared-marker set (CD4 and IL7R) is near zero, whereas full-context relevance shifts toward EM CD4. IL7R is also more abundant and ranks earlier in EM CD4 inputs. Given the model’s tendency to assign greater relevance to earlier-ranked genes (Fig. 3), this example illustrates how attribution can reveal context-dependent feature use while identifying expression rank as a potential confounding factor.