- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces TransMap, which converts single-cell gene expression profiles into two-dimensional images organized by biological relationships. Gene correlations and shared-nearest-neighbor geodesic distances define the relational structure, which is mapped onto distinct pixels through Gromov–Wasserstein transport and injective matching. For cross-species layouts, ortholog correspondences encourage related genes from different species to occupy nearby positions on a shared grid. The resulting images are used for masked self-supervised learning with a shared convolutional encoder, a local reconstruction head, and an expression prediction head operating on the cell embedding.
Critical strengths
Gene expression profiles have no natural two-dimensional coordinates. Using gene relationships to construct the input geometry provides an interpretable spatial prior for convolutional models. Assigning each selected gene to a separate pixel also avoids the loss of expression values caused by merging multiple genes.
The two-channel representation on page 4 distinguishes expression values from gene availability, and the loss is computed only over masked, available genes. This design accounts for differences in gene coverage across data sources.
Critical weaknesses
A central component of the method is the use of orthology to align input geometry across species. However, Table 2 on page 8 evaluates human and mouse datasets separately and does not test cross-species cell correspondence in the shared embedding space. The ability to process both species with one encoder does not establish that the model has learned transferable biological representations.
Equations (13) and (17) on pages 20–21 impose exact marginal constraints for both genes and pixels. In contrast, page 23 states that the human–mouse implementation enforces only the gene marginal exactly and uses a KL penalty with weight 1 for the pixel marginal. These are different optimization formulations. The authors should provide the objective actually used and clarify how it relates to the stated equations.
Questions for authors
Does the joint FGW layout improve cross-species cell retrieval or label transfer compared with independently constructed layouts? Could the authors provide controls without orthology constraints and with single-species pretraining?
Does TransMap still outperform random layouts, DeepInsight, and IGTD when the gene-level masks, model architecture, and parameter budget are held fixed?
5 comments
W2: marginal constraints
W2. Equations (13) and (17) on pages 20–21 impose exact marginal constraints for both genes and pixels. In contrast, page 23 states that the human–mouse implementation enforces only the gene marginal exactly and uses a KL penalty with weight 1 for the pixel marginal. These are different optimization formulations. The authors should provide the objective actually used and clarify how it relates to the stated equations.
Response:
Thank you for the careful reading; the reviewer is right that the two descriptions did not match. In Equations (13) and (17) we reproduced the standard textbook formulation of entropic (fused) Gromov–Wasserstein, with the coupling constrained to , without adapting it to our setting.
In our setting the grid has more pixels than genes, so exact marginals are neither appropriate nor what we solve: the implementation penalizes deviations from the two marginals with Kullback–Leibler terms of weight , which allows pixels to remain unoccupied and gives the solver more freedom to arrange genes.
This was an error in the write-up and does not affect any experiment: the layouts were computed with this relaxed objective throughout, so no result changes. We have replaced the constraint in Equations (13) and (17) with the KL-penalized objective, so that the stated equations now follow the implementation, and aligned the wording of Appendix E (page 23) accordingly. The one-gene-per-pixel property of the final layouts is unaffected, since it is enforced by the sparse matching step applied to the soft coupling.
Q2: layouts under fixed masks, architecture and parameter budget
Q2. Does TransMap still outperform random layouts, DeepInsight, and IGTD when the gene-level masks, model architecture, and parameter budget are held fixed?
Response:
The comparison with random layouts holds the architecture, the parameter budget, the data and the patch-masking scheme fixed, and the GW layout wins at every model size. In Table 1 the two layouts are trained with the same model at each size (458K and 15M parameters), on the same genes and data, and the GW layout has the lower reconstruction error in all ten comparisons, by 2.4–14.3%. At the scale of the final model, we pretrained three 147M-parameter models on random layouts with the corpus, architecture, optimizer and schedule of the main run. The GW layout raises the biological-conservation score of the zero-shot embeddings from 0.620 ± 0.022 to 0.700, with a gain on each of the five datasets, and the overall score from 0.441 ± 0.014 to 0.490 (Appendix G, Figure 8).
Masks are drawn on patches, so the set of masked genes follows the layout, and this favors the random layout. In the GW layout co-expressed genes sit in the same patch, so masking a patch removes a whole module at once: 20–33% of a gene's ten most correlated genes share its patch, against about 3% in a random layout, and the most similar gene that remains visible is less correlated with the masked one on every dataset (Appendix D.2, Figure 7). The GW layout reaches the lower error on the harder task. The 147M-parameter models are compared without any masks: embeddings are computed from the unmasked expression profile, so both models see the same input.
For DeepInsight and IGTD, Table A1 compares the layouts directly, and ours preserves the ordering of gene–gene distances best on all five datasets (Spearman 0.72–0.74, against 0.53–0.62 and 0.38–0.48). The TransMap layout also does something these methods cannot. They arrange the features of a single dataset, whereas ours places the genes of several species on one grid, with orthologs at corresponding pixels. This is what enables shared pretraining and the human-to-mouse transfer in our response to W1.
W1 + Q1: cross-species transfer
Response:
Thank you for this question. We ran the single-species control, and it shows that the representations transfer across species: a model pretrained on human data alone embeds mouse cells better than any other zero-shot model we evaluated. This model has the architecture and objective of the joint model and was trained on the human metacells only, matching the number of human-data updates in the joint run (28,360 steps, against 28,600). It has never seen a mouse cell.
(Overall scores, as in Table 2.)
The human-only model has the highest score on both mouse datasets, above the jointly pretrained model and above UCE, whose pretraining data include mouse. Its biological conservation on the mouse data equals that of the joint model (0.671 and 0.857, against 0.687 and 0.841), and its lead in the overall score comes from batch correction (0.105 and 0.212, against 0.016 and 0.167): a model that has never been trained on mouse data has not fit the technical variation of mouse datasets, so mouse batches mix better in its embedding.
An encoder that has only seen human expression images reads mouse cells because the unified layout puts each mouse gene at or next to the pixel of its human ortholog: half of the 17,108 high-confidence ortholog pairs share a pixel, and 64% lie within one pixel. The orthology-aligned geometry carries the transfer. Joint pretraining adds biological conservation: averaged over the five datasets it reaches 0.700, against 0.661 for the human-only and 0.572 for the mouse-only model, and the overall score is 0.490 against 0.472 and 0.431.
Appendix G describes the single-species models, and Figure 9 gives their scores on every dataset.