- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper proposes scGANT, a single-cell foundation model framework that incorporates biological prior knowledge into the attention mechanism rather than treating it solely as input-side token features. The framework has two main components: (1) a cell-conditioned prior induction module that modulates the relative weights of four biological prior channels; and (2) a biologically-guided attention mechanism that combines this signal with representation-based similarity to sparsely route and weight gene–gene information exchange. Evaluation covers three downstream task families: cell-type annotation, frozen-encoder batch integration, and perturbation prediction.
Critical strengths
- The observation that gene dependencies are biologically structured and cell-state-specific is sound, and the paper's central thesis that priors should modulate information exchange between gene tokens rather than merely enrich token embeddings is a legitimate and under-explored design axis. The multi-channel prior construction is more comprehensive than most prior work.
- Unlike many single-cell foundation model papers that evaluate only on cell-type annotation or embedding tasks, this paper attempts to validate on perturbation prediction, which probes whether the model has learned functional gene-response structure.
Critical weaknesses
- Novelty is substantially undermined by closely related concurrent work, and the related-work treatment is inadequate. GRNFormer [1] already proposes a "biologically-guided framework" that integrates gene regulatory networks into RNA foundation models. The substantive distinction between scGANT's cell-conditioned prior induction and GRNFormer's adaptive cross-attention over cell-specific GRNs is not clearly articulated, let alone empirically compared. Given that GRNFormer is the most directly related prior work, its absence from the experimental comparison and the inaccurate characterization in Related Work are material concerns. Additionally, more recent foundation models such as CellFM [2], and TranscriptFormer [3] are not compared, despite being published or available before submission.
- scGANT reports perturbation results comparing only against GEARS, PRESAGE, Geneformer, scPRINT, and scGPT, none of which include a mean, linear, or "no-change" baseline. Without these controls, it is impossible to determine whether scGANT's reported gains reflect genuine biological learning or merely relative positioning among models that all underperform trivial baselines.
- Writing quality and notation are below the standard expected for a conference submission. The manuscript exhibits numerous issues consistent with insufficient human revision: notation is introduced without definition; intermediate variables proliferate without clear relational exposition.
References [1]GRNFormer: A Biologically-Guided Framework for Integrating Gene Regulatory Networks into RNA Foundation Models [2]CellFM: a large-scale foundation model pre-trained on transcriptomics of 100 million human cells [3]TranscriptFormer: A generative cell atlas across 1.5 billion years of evolution
Questions for authors
The revision suggestions is the same as that in Critical Weaknesses.
Rebuttal Summary
Dear AC,
Thank you very much for the time and effort you have devoted to handling our submission. Below is a brief summary of our paper and the rebuttal for your consideration.
1. Strengths of the paper
2. Strengths recognized by the reviewers
All three reviewers recognized the direction of our work. Reviewer nK1W described it as "interesting and important" and noted that "the results demonstrate substantial improvements and the evaluation covers both cell-level and gene-level tasks". Reviewer mX7Y wrote "I very much like the direction that the authors are taking". Reviewer Svxe called our thesis "a legitimate and under-explored design axis" and the multi-channel prior construction "more comprehensive than most prior work".
3. Main concerns addressed
The revised manuscript has been uploaded, with all changes marked in purple.
4. Status of the discussion
Reviewer nK1W confirmed that the additional experiments and clarification that the response have resolved the concerns. After our first response, Reviewer Svxe had two remaining concerns, and we responded to both in detail and further revised the paper accordingly. We have also responded in detail to each of Reviewer mX7Y's initial comments.
Thank you again for your time and consideration!
Best regards,
The Authors