- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the biological interpretability of Cell-to-Sentence (C2S) single-cell language models using sparse autoencoders (SAEs). The authors train SAEs on intermediate residual-stream activations from C2S Gemma-2-2B and examine their reconstruction fidelity, feature organization, and biological relevance. The learned features are associated with cell-type markers and Gene Ontology terms, while intervention experiments investigate whether manipulating these features can steer cell-type predictions. Experiments on PBMC datasets show that SAE reconstruction largely preserves cell-type annotation accuracy, deeper-layer features exhibit greater cell-type specificity, and selected feature interventions can redirect model predictions. Additional analyses examine feature utilization, redundancy, and reconstruction robustness across datasets.
Critical strengths
- Interesting application of mechanistic interpretability to single-cell language models.
- Complementary reconstruction and intervention analyses.
Critical weaknesses
-
Limited generalizability of the experimental evaluation. The study focuses exclusively on C2S Gemma-2-2B and three relatively well-separated immune cell types. It remains unclear whether the observed feature organization and steering behavior extend to other single-cell foundation models, more heterogeneous cell populations, or finer-grained biological distinctions.
-
Insufficient validation of biological feature interpretation. The authors associate SAE features with genes presented in isolation and use marker associations and GO enrichment to establish biological relevance. However, this procedure may primarily recover known gene semantics and cell-type markers rather than context-dependent biological knowledge. The relationship between isolated-gene feature associations and feature activation in complete cellular contexts is not sufficiently established.
-
Lack of appropriate controls for feature steering. The steering experiments demonstrate changes in cell-type predictions but do not compare against matched random-feature or alternative-direction interventions. Moreover, some interventions produce substantial off-target prediction changes, as illustrated in Appendix J.2. Without stronger controls and a systematic assessment of target-specific versus unintended changes, the results provide limited evidence for precise biological control.
-
Limited downstream validation of SAE representation fidelity. The main reconstruction experiments primarily evaluate annotation of three easily distinguishable cell types, where the original model already achieves approximately 96–97% accuracy. Preserving performance on this relatively simple task does not establish that SAE reconstruction retains more complex biological information, such as cellular states, regulatory programs, or perturbation responses. This limits the evidence supporting broader claims about the utility of the reconstructed representations.
Questions for authors
-
Could the authors provide a matched random-feature or random-direction steering baseline? Comparing target-directed and off-target prediction changes would help establish whether the observed interventions are specific to the identified biological features.
-
How consistent are the feature-to-gene associations when genes are evaluated within complete cell contexts rather than in isolation? Clarifying this distinction would strengthen the interpretation of the GO enrichment results.
-
Could the authors quantify the proportion of steering-induced changes that reach the intended target label versus unrelated labels across different layers? The supplementary results suggest substantial variation in steering specificity.
6 comments
Reply to Reviewer msqr Cont'
Reply to Q3: on-target rate of steering across layers
We thank the reviewer for this question. We quantified it over all cross-layer steering runs in Table 19: features from layers 10, 15, and 20 added at layer 10, at magnitudes 30, 40, and 50, on both datasets and both splits (108 runs). We fix the intervention at layer 10 because same-layer steering at layers 15 and 20 produces little or no shift toward the target (Figure 5). For every cell whose annotation changes, we record whether the new label is the target, one of the other two studied cell types, or any other label. We report the on-target rate, i.e., the share of changed annotations that reach the target label; this is what the reviewer refers to as steering specificity.
| Feature source layer | Cells changed | Reach target | Reach another studied cell type | Reach any other label |
|---|---|---|---|---|
| 10 | 3,289 / 13,149 (25.0%) | 2,458 (74.7%) | 78 (2.4%) | 753 (22.9%) |
| 15 | 9,362 / 13,149 (71.2%) | 7,853 (83.9%) | 0 (0.0%) | 1,509 (16.1%) |
| 20 | 6,827 / 13,149 (51.9%) | 3,541 (51.9%) | 21 (0.3%) | 3,265 (47.8%) |
| Overall | 19,478 / 39,447 (49.4%) | 13,852 (71.1%) | 99 (0.5%) | 5,527 (28.4%) |
The on-target rate does vary with the source layer, as the reviewer observes. Pooled over cell types, it is highest for layer-15 features (83.9%) and lowest for layer-20 features (51.9%). The ranking depends on the target, however: it is driven by CD14 monocytes and NK cells, whereas for B cells about half of the changes reach the target at every layer. For comparison, random directions reach the target in 0.7–0.8% of changed cells at every source layer (Q1). The table below gives the on-target rate for each target cell type:
| Target cell type | Layer 10 | Layer 15 | Layer 20 |
|---|---|---|---|
| B cell | 692 / 1,248 (55.4%) | 1,677 / 3,126 (53.6%) | 1,239 / 2,208 (56.1%) |
| CD14 monocyte | 1,727 / 1,940 (89.0%) | 2,636 / 2,696 (97.8%) | 1,336 / 2,625 (50.9%) |
| NK cell | 39 / 101 (38.6%) | 3,540 / 3,540 (100%) | 966 / 1,994 (48.4%) |
With layer-15 features, nearly all changes reach the target for CD14 monocytes and NK cells: for NK, every cell not already annotated as NK is relabeled as NK at all three magnitudes on both datasets, so the annotation saturates. The on-target rate also rises with magnitude at layers 10 and 15 (from 63.3% to 86.7% and from 76.0% to 90.1% between magnitudes 30 and 50) but plateaus near 55% at layer 20.
Most off-target changes are not to unrelated labels. They rarely go to one of the other two studied cell types (0.5% of changed cells) and instead concentrate on a few labels that depend on the source layer and target:
- Layer 15: 1,426 of the 1,509 off-target changes are malignant cell, all under B-cell steering. With beam-search decoding, B cell is the second-ranked label for most of these cells (Appendix K.2.2).
- Layer 20, B-cell features: 865 of 969 off-target changes are dendritic cell. These features combine B-cell receptor genes with MHC class II genes, a program shared with dendritic cells.
- Layer 20, CD14 features: 1,287 of 1,289 off-target changes are myeloid cell, leukocyte, or dendritic cell, i.e. coarser or neighboring labels within the same lineage.
- Layer 20, NK features: these have the lowest on-target rate. Off-target cells receive CD4 T cell or generic labels (native cell, progenitor cell, leukocyte), and 859 of the 966 target transitions are mature NK T cell, which our matcher accepts as an NK label, so 48.4% is an upper bound (Appendix K.2.4).
The lower on-target rate of layer-20 features therefore reflects programs that the target shares with other cell types (antigen presentation, cytotoxicity) rather than a nonspecific perturbation.
We have also expanded the case studies in Appendix K.2 to document this in more detail. The appendix now reports, for every source layer, magnitude, dataset, and split, the number of changed annotations and the number that reach the target (Table 19). It adds a separate case study for each target cell type that traces which labels the off-target cells receive, and uses beam-search decoding (width 5) to test whether the target label is still among the model's top candidates when it is not the first choice. Finally, it explains why later-layer features redirect annotations (Appendix K.2.5): the most cell-type-specific layer-20 features encode programs shared with other cell types, and the injected vector is five to eight times the class-centroid offset at layer 15 but only about twice that offset at layer 20, so layer-15 features saturate the annotation whereas layer-20 features act as a partial edit.
Reply to Reviewer msqr Cont' 2
Additional weaknesses addressed
W1: Limited generalizability of the experimental evaluation
We agree that the evaluation covers one model and three cell types, and we now explicitly acknowledge this limitation in the Limitations section. The restriction to well-separated populations was deliberate, for the reason given in Appendix B.1. Testing whether SAE features align with biological concepts requires reliable ground truth. B cells, CD14 monocytes, and CD56 NK cells have high-confidence labels and well-established marker genes (Zheng et al., 2017), and together they span the lymphoid and myeloid lineages and the adaptive and innate arms of immunity. Finer distinctions, such as naive CD4 versus CD8 T cells, overlap transcriptomically to the point that protein or chromatin measurements are needed to resolve them (Hao et al., 2021). There, a mismatch between a feature and a label could reflect label noise or shared programs rather than the model, and we could not tell these apart. The controlled setting is what allows us to attribute our findings to the model. Extending to the 27B model exceeded our computational budget.
Within this scope, two results bear on generalization. First, SAEs trained only on purified-PBMC transfer to the PBMC-4k and PBMC-8k datasets, which were unseen during SAE training: reconstruction preserves annotation accuracy (Table 1), and steering and the random-direction controls behave consistently on both (Figures 6 and 7). Second, our analyses already expose structure finer than the three labels. Monocyte-selective features carry antigen-presentation programs shared with dendritic cells (Section 4.2), and steered cells that miss the target mostly receive neighboring labels such as dendritic cell and myeloid cell (Appendix K.2; see Q3). This suggests the framework can resolve finer distinctions where the labels support them.
Beyond these specific findings, we do not claim that these specific layer-wise findings generalize to other models or tissues. Rather, we encourage future work to apply this pipeline to investigate what biological information different models learn, across datasets of varying annotation granularity. The pipeline requires only gene-token activations and cell-type labels, and we release our code so that it can be readily adapted to new settings.
W2: Annotation is a simple task for validating SAE reconstruction
We agree on what the annotation result does not show, but we respectfully disagree that this weakens the role reconstruction plays in our study.
Cell-type annotation is not an incidental benchmark for this model. It is one of the core tasks on which Cell2Sentence models are trained and evaluated, from the original Cell2Sentence paper (Levine et al., 2024) to C2S-Scale, and it is the task for which a per-cell output can be scored objectively against ground truth. It is also harder than a three-way classification. The model generates a free-text label from an open vocabulary (its outputs include dendritic cell, naive B cell, and leukocyte), and the SAEs were trained on activations collected without the annotation prompt, so the test also measures transfer across prompt contexts.
The purpose of the test is to license the analyses that follow, all of which concern cell-type identity and the gene programs behind it: feature selectivity, marker and GO associations, and steering of annotations. For this purpose, annotation is the relevant behavior. We do not claim that the reconstructions retain cellular states, regulatory programs, or perturbation responses.
Three further results support the reconstructions beyond annotation accuracy:
- Task-agnostic fidelity. The SAEs explain 95.1-97.6% of activation variance on held-out cells, more than PCA with the same number of directions (88.9-95.8%; Table 7).
- Preserved response to interventions. Reconstructed activations respond to feature steering in the same way as the original activations (Figure 5), so reconstruction preserves the causal role of the features and not only the final label.
- A more complex task. We also evaluated natural-language interpretation of groups of cells (Appendix H). The base model itself produced near-identical text that was not specific to the input cells, so this task cannot distinguish original from reconstructed representations for the 2B model. We excluded it from the main analysis for that reason.
Reply to Reviewer msqr
Reply to Q1: random-direction steering baseline
We thank the reviewer for this suggestion and have added a matched random-direction control (Section 5.3, Figure 7). For each set of 15 marker features, we sample 15 Gaussian random directions, remove their projection onto the span of the selected features, and rescale them to the mean decoder norm. The controls thus match marker steering in the number of directions, norm, intervention layer (layer 10), and steering magnitude (40). The 36 marker conditions cover three target cell types, marker sets from three layers, two datasets, and two splits; each is paired with three random seeds, giving 108 control runs.
Random directions do perturb the model, but not toward the target. They change the predicted annotation of 17.5% of cells on average (range 1.0-51.7% across runs), compared with 50.7% (1.7-88.9%) for marker steering. Of the 6985 annotations they change, only 55 (0.8%) move to the target cell type, never more than 3 in a single run, and the average count of net change in target is -21.1 cells. Instead, 97.6% of the changed cells receive labels outside the three studied cell types, mainly dendritic cell, leukocyte, myeloid cell, and CD8+ T cell.
In contrast, 72.0% of the annotations changed by marker steering (4764 of 6616) move to the target cell type. Marker steering raises the target count in 35 of 36 conditions, by +127.4 cells on average; the only exception is layer-15 B-cell features on the purified-PBMC test split (-10 cells).
The labels that random directions produce depend on the random seed, not on the marker set the directions were orthogonalized against. Seeds 42 and 1234 send most changed cells to dendritic cell (61% and 84% of changes), which is the most common new label in 69 of their 72 runs regardless of the target cell type. Seed 0 instead yields mostly myeloid cell, leukocyte, and CD8⁺ T cell. The share of cells changed also follows the seed: 1.0-8.1% for seed 42, 1.7-17.6% for seed 1234, and 29.7-51.7% for seed 0.
The shift toward the intended cell type therefore depends on the identified feature directions and is not a generic response to perturbing the residual stream.
Reply to Q2: feature-to-gene associations in context
We thank the reviewer for raising this distinction. The associations hold in context at layers 10 and 15 but not at layer 20, and we have added an analysis to demonstrate this distinction (Section 4.3, Figure 4).
We define feature-to-gene associations from isolated genes because an in-context gene token attends to the genes preceding it, so only a context-free input attributes a feature's response to gene identity alone. To further test how these associations behave in context, we track 65 marker genes across up to 50 occurrences each in held-out cells.
At layers 10 and 15, a marker-annotated feature separates its gene's tokens from all other gene tokens almost perfectly (median AUROC 1.00 and 0.98), and 59% and 46% of its top-activating tokens fall on its annotated genes, compared with 38% and 32% for random features. At layer 20, this token-level selectivity disappears (median AUROC 0.54; 19% of top tokens, the same as for random features). By this depth, gene representations are dominated by cellular context: occurrences of the same gene in different cells share about as few top features as different genes within the same cell.
The GO enrichments should therefore be read differently by depth. At layers 10 and 15, they describe the genes a feature responds to in context. At layer 20, they describe the cellular program a feature encodes: the marker gene presented alone evokes the feature, whereas in context the feature tracks cell type, consistent with the high cell-type selectivity of layer-20 features (Figure 2). We have revised Sections 2.3 and 4.3 to make this distinction explicit.