- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
The paper tests the Platonic representation hypothesis using 33 gene embeddings from text, sequence, network, expression, perturbation, and imaging models. Mutual-kNN agreement is above chance and correlates with gene-property prediction (r = 0.75). The authors combine six models into a PLANTAGENET consensus that improves gene-property prediction. They also derive two cell scores, ρc and Dc, from the consensus. These distinguish real cells from shuffled, marginal, and chimeric profiles, with reported AUROCs of 1.000, 0.992, and 0.845, respectively.
Critical strengths
The comparison covers 33 gene representations across very different modalities. I also like the simplicity of the cell scores: they require no training and provide a novel way to use gene-level representations to assess cells.
Critical weaknesses
-
The headline cell results come from the easiest setting. In the combined experiment, chimeras and marginals mix blood with brain, so the experiment mostly tests whether the scores detect cross-tissue mixing. Within tissue, Table S4 shows that the consensus is near chance for chimeras (0.55 to 0.63) and brain marginals (0.49 to 0.54). Shuffled profiles are trivial for every model.
-
The paper lacks baselines for the cell scores. There is no comparison with detected-gene count, co-expression likelihood, or the authors' own atlas PCA views. Doublet detectors such as DoubletFinder are also missing, even though the chimeras are synthetic doublets. The stated use case is evaluating generative-model outputs, but none are tested.
-
The novelty is limited by earlier work on multimodal gene-embedding integration. The paper does not cite arXiv 2507.07367, and PRESAGE already concatenates seven views. Kan-Tor et al. (2024), whose benchmark is used here, also reported complementarity across model families.
-
Several confounds affect the convergence analysis. Fold-over-chance (≈ k/|G|) favors pairs that share more genes. PRESAGE overlaps with its own components, inflating the correlation, while text and network embeddings share sources with the benchmark labels.
-
The consensus gains are small. VI and VIII differ by 0.004 AUROC, with no variance reported. The headline numbers also mix results from the concatenation and Procrustes variants.
Questions for authors
- How do ρc and Dc perform within tissue compared with doublet-detection and co-expression baselines?
- Does the correlation between agreement and performance hold when you use a common gene set and exclude PRESAGE?
- How does PLANTAGENET compare with existing integration methods or with concatenating the top-k models?
5 comments
Response to reviewer yjQN (2/3)
(part 2/3)
W2: The paper lacks baselines for the cell scores. [...]
We expanded the cell-level evaluation with conventional QC statistics and reference-dependent methods, including PCA reconstruction, expression-space distance, co-expression likelihood, and doublet detector (Scrublet; Table S14).
Our geometric scores outperform the four conventional QC statistics on several corruption tasks, including marginal and chimeric profiles in blood and combined blood-and-brain settings. Specialized reference-dependent methods, however, can perform better on chimeras: Scrublet reaches AUROC 0.871 versus 0.637 for coherence in blood, and 0.923 versus 0.556 in brain; expression-space distance reaches 0.950 versus 0.845 on combined blood-and-brain chimeras (Table S14). The distinction is that our scores use pretrained gene-space geometry without requiring a reference-cell population at evaluation time. Additional comparisons with same-modality and atlas-PCA representations are reported in Table S12.
The atlas-PCA views score higher in tissue-specific settings, but only because they are fit on the very atlases the test cells come from (which our scores don’t have access to); the multimodal consensus remains best on the combined blood-and-brain setting (Table S12)
Manuscript: We expanded Sec. 4.3 and Appendix F.7 with the cell-scoring comparisons (Table S14), and report the representation controls in Appendix F.4 (Table S12).
W2: The stated use case is evaluating generative-model outputs, but none are tested.
We agree that detecting selected synthetic corruptions does not establish biological validity for arbitrary generated or experimentally perturbed cellular states. The current results establish a reference-free geometric scoring approach and characterize its behavior on several constructed corruption types. Evaluating previously unseen cellular states against independent biological validity criteria remains a future application, beyond the scope of this work which intends to set the foundations.
Manuscript: We clarify the demonstrated scope of Sec. 4.3 and the prospective generative-model motivation in the Discussion, Sec. 5.
W3: The novelty is limited by earlier work on multimodal gene-embedding integration. The paper does not cite arXiv 2507.07367, and PRESAGE already concatenates seven views. Kan-Tor et al. (2024), whose benchmark is used here, also reported complementarity across model families.
We agree that multimodal gene-embedding integration and complementarity across modalities are established concepts and thank the reviewer for highlighting the missed reference to PRISME (Zheng et al., 2025). We would like to highlight that in each of the previous works the multimodality was explored from a different lens and towards a different objective:
- Kan-Tor et al. (2024) demonstrated modality-specific strengths in gene-property prediction;
- PRESAGE (Littman et al., 2025) integrates multiple gene-embedding sources for perturbation-response prediction; and
- PRISME examines cross-modal representational similarity and integrates embeddings through an autoencoder.
We believe our contribution is different, it is not a new concatenation or alignment algorithm. Rather, we connect the systematic analysis of cross-modal gene agreement, its use in selecting representations for a training-free consensus space, and the application of the resulting geometry to cell-level analysis.
Manuscript: We expanded the related-work discussion in Sec. 2 and clarified the selection rationale in Sec. 3.5.
Response to reviewer yjQN (3/3)
(part 3/3)
Q3: How does PlantaGenet compare with existing integration methods or with concatenating the top-k models?
We evaluated top- combinations across gene-property prediction and cell rejection (Figures S27 and S32). Gene-property prediction largely saturates at approximately four representations, while cross-tissue chimera rejection continues to benefit from additional models. In contrast, adding views can reduce performance for brain-only marginal corruptions. These findings demonstrate that contributions are task-dependent, rather than establishing a universally optimal number of representations. We also added an ensemble averaging predictions from the six individual models (Table S8). The ensemble achieves an all-task AUROC of 0.892, comparable to PlantaGenet VI Procrustes (0.886). This results motivate the integration of complementary biological information across representations. PlantaGenet builds on this principle by integrating the different views into a single, reusable gene representation space, whose geometry can be leveraged directly for downstream cell-level analysis (which the ensemble method can’t provide).
Manuscript: We added the top-k sensitivity analysis to Sec. 4.2 and 4.3 and Appendix E.5 (Figure S27) and F.5 (Figure S32) and the ensemble method to Sec 4.2 and Appendix E.3 (Table S8)
Q2: Does the correlation between agreement and performance hold when you use a common gene set and exclude PRESAGE?
We now evaluate agreement on two common-gene panels (Table S4). Excluding the two integrated PRESAGE representations preserves the positive association between biological-process prediction and calibrated agreement after controlling for model characteristics (, ).
The relationship also persists in the broader 16,385-gene evaluation (, ). We hope these results reduce concerns about differing gene coverage and dependence on integrated views.
Manuscript: We clarified the common-gene evaluation in Sec. 3.2 and expanded the controlled analyses in Sec. 4.1 and Appendices A-C (Table S4; Figures S18–S21).
W5: The consensus gains are small [...] The headline numbers also mix results from the concatenation and Procrustes variants.
We corrected the variant-specific comparisons in Sec. 4.2 and added uncertainty estimates across 10 CV seeds and tasks composition (Table S6). We also reported confidence intervals for the cell rejection task (Table S11). We do not interpret the VI–VIII differences as improvements – the motivation for VI is to reduce dependence on tissue-specific atlas representations (by removing the PCA-views fitted on these altases) rather than maximize benchmark AUROC.
Manuscript: We revised Sec. 4.2 and provide the uncertainty analysis in Appendix E.1 (Table S6) and F.3 (Table S11)
Response to reviewer yjQN (1/3)
(part 1/3)
We thank the reviewer for recognizing the breadth of the representation analysis and the potential value of the cell-level geometric scores. In response, we expanded the evaluation with conventional and reference-dependent cell-scoring baselines, analyses of tissue-specific chimera difficulty, and controls examining alternative consensus constructions. We also clarified the relationship to previous multimodal gene-embedding integration work.
We are happy to engage in further discussion (:
We expanded the evaluation to compare our geometric scores with conventional QC metrics, co-expression likelihood, expression-space methods, and Scrublet across both combined and tissue-specific settings (Table S14).
Importantly, ρc and Dc require only the expression profile of the evaluated cell and a pretrained gene representation, whereas co-expression and doublet-detection methods rely on a reference population. Despite this distinction, our scores perform competitively across most settings. Our scores also detect gene-shuffled profiles with near-perfect accuracy across tissues, while conventional QC statistics perform at near chance. Specialized reference-dependent methods achieve higher performance on certain chimeric profiles, particularly in the brain setting. Our graded-chimera analysis (Figure S33) helps explain this behavior; rejection becomes more challenging as the transcriptional similarity between source cell types increases. We believe these comparisons highlight the value of assessing cellular coherence directly through gene-space geometry, without requiring a representative reference population or task-specific model fitting. And wish to clarify we designed the metrics as complimentary and not as the unique evaluation system.
Manuscript: We expanded Sec. 4.3 with the tissue-specific and cell-scoring comparisons, supported by Appendix F.7 (Tables S14) and the graded-chimera analysis in Appendix F.8 (Figure S33).
We agree that cross-tissue chimeras are easier to reject than within-tissue mixtures. We therefore evaluated chimeras generated from 406 source-cell-type pairs spanning different transcriptional similarities (Figure S33).Rejection decreases as source-type similarity increases (Spearman rs=−0.65 for coherence and −0.58 for dominant dimensionality). Varying the mixing ratio has a smaller effect (Figure S33). These findings explain part of the performance gap between combined and tissue-specific settings (Table S12) and are now mentioned in section Sec 4.3.
Manuscript: We expanded the tissue-specific interpretation in Sec. 4.3 and added the graded-chimera analysis in Appendix F.8 (Figure S33).