- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This is a strong and well organized work that uses text embeddings as a shared space for gene expression and electrophysical neuron data. The authors use CLIP to align the two embeddings and translate between modalities. I find this work easy to follow and the method to be interesting and novel, despite performance improvements being occasionally only modest over previous methods. Transfer between mouse cortices is effective in several electrophysical features, while cross-species transfer is not as strong. Attribution/interprability results are mostly anecdotal but are presented as such.
Critical strengths
The proposed method provides state of the art performance translating between gene expression and neuron electrophysical data. The gains are modest in some circumstances, but the method consistently outperforms the competing methods and beats the best competitor - JAMIE - the majority of the time. The method also transfers somewhat between mouse cortices, showing some promise for general zero shot transfer.
Using a pretrained text encoder as a shared embedder for disparate modalities in this way is a novel idea and could be broadly useful. This allows modalities to begin in the same latent space without any (or with minimal) training. Vocabularies/fields in certain data can be missing without causing the resulting representation to break and new modalities could be added easily in theory. Although there might be some information lost in the text bottleneck, I could see a similar method being effective applied to different modalities and domains.
Critical weaknesses
Ablations are lacking cases that prove the full method is necessary. While we see improvements with the proposed method, it is not clear whether the shared text embedding specifically is useful. Would CLIP embeddings of separate numerical expression and numerical electrophysical embeddings work as well? Or genePT text + numerical electrophysical?
Cross species transfer is somewhat weak. Mouse->human transfer gives poor performance, but does improve significantly when fine tuning on only a few samples. Would human->mouse transfer work?
Questions for authors
Please clarify whether the gene and electro-physical text embeddings use the same model. Fig 1 and the overview paragraph say they 'use the same frozen general purpose text embedder' (line 191) but shortly after (line 201) says that the gene text is passed through frozen GenePT embedding, which is what I originally assumed to be the case.
It is important to at least quantify the contribution of the choice to use the text space (see first weakness above). Would it be possible to test versions with choices of text/numerical embeddings for both expression and electrophyscial modalities?
I think it could be good to highlight the mouse->human performance improving with some extra low data training. This is up to the authors though.
3 comments
2. Would human → mouse transfer work? (Weakness 2)
Yes, and human → mouse transfer is stronger than mouse → human. We trained LangPatch on the 612 human neurons only and applied it without adaptation to the 3,654 mouse visual-cortex neurons, following the evaluation protocol of the paper.
| Direction | Training cells | Mean r | Concepts above the null | Retention | Gene-permuted control (mean r) |
|---|---|---|---|---|---|
| Mouse → human (paper) | 3,654 mouse | 0.28 | 18 of 25 | 47% (58% on acute slices) | 0.00 |
| Human → mouse (new) | 612 human | 0.39 | 23 of 24 | 63% | −0.02 |
Input resistance, rheobase, membrane time constant and after-hyperpolarization transfer with r between 0.62 and 0.68. One of the 25 concepts (the adaptation index) has no counterpart among the human features, so 24 concepts are evaluated in this direction.
Zero-shot transfer therefore holds across species in both directions, and is stronger toward the species with cleaner target recordings despite six times fewer training cells. This may suggest that mouse → human transfer is limited more by variability in the human recordings than by the species gap.
3. Do the gene and electrophysiology text embeddings use the same model? (Question 1)
Yes. Both use OpenAI text-embedding-3-large (3,072 dimensions). GenePT is not a separate network. It passes each gene's text summary through a general-purpose text embedder, the newest version via text-embedding-3-large. We embedded the recordings with that same model. As a check, we re-embedded the gene summaries ourselves and recovered the released GenePT embeddings (cosine similarity 1.000).
The sentence you point to (line 201 of the submission, in Sec. 3.1) now reads: "Gene j is represented by g_j = E(description of gene j), computed with the same embedder E as the recordings. These vectors are the released GenePT embeddings (Chen & Zou, 2025), which are text-embedding-3-large applied to each gene's NCBI and UniProt summary." The caption of Fig. 1 has been updated accordingly.
4. Highlighting few-shot mouse → human transfer (Question 3)
We have done so: Sec. 5.3 now devotes a paragraph to this result. Calibrating the mouse-trained model on 20 paired human cells yields an error within 2.5% of that obtained with 100 cells. With 25 labelled human cells, a ridge head on the frozen mouse-trained representation achieves r = 0.270, compared with 0.197 for Plain GenePT and 0.195 for Geneformer.
Changes in the revised PDF. Sec. 5.4 with Table 2 and Fig. 4 (new): text versus numerical embeddings, text-embedder ablation and cross-laboratory test. Sec. 5.3: cross-laboratory test, human → mouse transfer and the few-shot paragraph. Sec. 3 and the caption of Fig. 1: clarification of the embedder. Appendix A (new): text-embedder table (Table 4) and per-concept human → mouse results (Table 5).
Thank you for performing the requested experiments and answering my questions. I believe that these new results, particularly the text/numerical comparison under the same scheme as the proposed method and the new missing feature exploration greatly strengthen this work. I additionally appreciate the clarification on the text embedder (text-embedding-3-large) - I think it is important to make this part clear and the updated language you show does this well. I have raised my score to a 4.
Thank you for the careful reading and the constructive questions. We have run all the experiments you suggested.
1. Is the shared text space useful? Text or numerical embeddings for each modality (Weakness 1, Question 2)
We evaluated all four combinations of text-based and numerical embeddings for the two modalities. LangPatch, which uses text for both, achieves the best forward-prediction accuracy.
(a) Text or numerical, for each modality. Forward prediction on held-out cells (Metrics: Pearson r / raw MAE / AUROC, using five-fold means). AUROC is computed per feature: held-out cells are split at the feature's median, and the prediction is scored on how well it separates the upper half from the lower half (0.5 is chance).
LangPatch achieves the best performance on all three metrics in both cohorts. Replacing both modalities with numerical embeddings reduces r by 0.10 on visual cortex and by 0.04 on motor cortex. Pretrained numerical expression embeddings (MLPs on frozen Geneformer, UCE and Nicheformer; Table 1) achieve at most r = 0.492 and 0.503.
All new variants use the same training objective, folds and readout head as the LangPatch row, so that only the embeddings differ. The numerical encoders take log-normalized expression and quintile-binned electrophysiology features as input. The last two rows are taken from Table 1 of the paper.
(b) Choice of text embedder. We re-embedded the gene descriptions and recordings with ten alternative embedders and retrained LangPatch with all other settings fixed. FOSCTTM measures the alignment error on held-out cells (0 is perfect, 0.5 is chance).
FOSCTTM decreases from 0.225 and 0.271 with a bag-of-words representation to 0.109 and 0.139 with the embedder used in LangPatch, indicating that alignment quality improves with the quality of the text embedder.
(c) Zero-shot generalization to another laboratory's feature set. You note among the strengths that "Vocabularies/fields in certain data can be missing without causing the resulting representation to break". We tested the extreme case in which the entire feature set differs. The visual-cortex model, trained on 39 Allen Institute features, was applied to motor-cortex recordings described by the 29 features of Scala et al. (https://doi.org/10.1038/s41586-020-2907-3; no feature names in common), without a feature correspondence and without retraining. Family label-transfer accuracy between the recording and transcriptome embeddings of the same cells is 0.51 against a permutation null of 0.19, and 0.78 against 0.30 on interneuron families (the classes seen during training). This setting is infeasible for numerical encoders: their input layer is tied to the feature set of the training cohort, so applying them to another laboratory's features requires a manually constructed feature correspondence or retraining.