- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes scPathVQ, a pathway-guided discrete representation learning framework for single-cell understanding and generation. The method organizes gene expression into pathway-induced patches complemented by highly variable gene tokens, integrates them through cross-attention, and compresses the resulting representations using learnable latent tokens and vector quantization. The quantized latent sequence supports perturbation response prediction, while a gated pooling mechanism produces continuous cell embeddings for downstream understanding tasks. The model is pretrained on approximately 34 million human cells and evaluated on cell-type annotation, batch integration, perturbation prediction, and functional cell-state inference. Experiments demonstrate competitive performance across these tasks, with additional ablations and pathway-level analyses investigating the proposed components.
Critical strengths
- Unified representation for understanding and generation.
- Strong performance across multiple benchmarks.
Critical weaknesses
-
Insufficient validation of pathway-guided tokenization. The proposed tokenizer flattens overlapping KEGG pathways, removes duplicate genes, and partitions the resulting sequence into fixed-size patches. Consequently, individual patches do not necessarily correspond to coherent biological pathways. Although removing pathway tokens reduces performance in Table 2, this ablation does not establish whether the gains arise from meaningful biological organization or simply from additional gene information and structured compression. A comparison with randomly grouped genes under a matched token budget would be important for supporting the central motivation.
-
Limited evidence for the necessity of discrete representations in generation. While the paper motivates vector quantization as a key component for preserving structured cellular states, the main component ablations in Table 2 focus on cell-type annotation. The perturbation experiments do not directly compare quantized sequences against their continuous latent counterparts or pooled representations under the same prediction architecture. Therefore, it remains unclear whether the reported generation improvements specifically require the proposed discrete latent interface.
Questions for authors
-
Could the authors clarify how the pathway-token ablation controls for differences in input gene coverage and representation capacity? Is there any comparison against random or otherwise biologically unstructured gene grouping with a matched number of patches?
-
Could the authors compare perturbation prediction using the quantized latent sequence against the corresponding continuous latent sequence, keeping the downstream prediction head unchanged? This would help establish the contribution of vector quantization to generation.
-
Could the authors clarify whether the downstream annotation datasets overlap with the pretraining corpus and whether the annotation splits are donor or study disjoint? This would help assess how strongly the reported results demonstrate generalization to unseen biological samples.