- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
CellRefine introduces a biologically guided adaptation stage between foundation-model pretraining and downstream fine-tuning. It aims to improve representations of rare cell types and robustness to distribution shifts. The method aligns cell embeddings with learned prototypes constructed from curated marker-gene sets, adds an ontology-based loss to distinguish closely related cell types, and uses Gaussian-mixture variational regularization to structure the latent space. These objectives supplement the backbone’s original pretraining loss.
The authors evaluate CellRefine with scBERT, scGPT, and Geneformer across cell-type prediction, spatial expression imputation, and perturbation-response prediction, reporting consistent improvements over the corresponding backbones. Validation includes cross-dataset classification, transfer from scRNA-seq to spatial data, and response prediction for held-out cell types. Additional experiments examine rare-cell performance, individual loss components, compute-matched training, random or shuffled marker controls, marker coverage, and hyperparameter sensitivity. The strongest evidence concerns improved cell-type discrimination, while gains in imputation and perturbation-response prediction are smaller.
Critical strengths
The paper makes a credible case that curated marker knowledge can improve pretrained cell representations beyond continued pretraining alone. Its compute-matched, random-prototype, random-marker, and shuffled-marker controls help distinguish the contribution of biological information from extra optimization or generic supervision. The marker-coverage experiments further support this interpretation. These controls strengthen the central methodological claim.
The improvements extend across three foundation-model backbones and several downstream settings, including cross-dataset cell annotation and transfer to spatial transcriptomics. Class-level results also show gains for rare and closely related populations, directly supporting the paper’s motivation. This breadth makes the approach more convincing than an improvement confined to one architecture or classification dataset.
Critical weaknesses
The method explicitly pushes apart cell types sharing a parent lineage and encourages a clustered latent structure, but does not establish that this preserves continuous biological variation. Closely related populations can represent adjacent developmental or activation states, so stronger separation is not inherently a better biological representation. The UMAPs and classification metrics largely reward the structure imposed by the training objectives. Without evaluating trajectories, transitional populations, or within-type state variation, the claim that CellRefine improves the underlying representation remains incomplete.
Evidence for broader functional transfer is limited. Spatial imputation is evaluated on two liver datasets, while perturbation-response prediction uses a single peripheral-blood dataset and compares primarily against the same three foundation-model backbones. The improvements are modest, and the absence of perturbation-specific methods or simple response-transfer baselines makes their practical significance difficult to assess. Consequently, the experiments support improved cell-type discrimination more convincingly than the broader claim that marker-guided refinement improves functional biological modeling.
Questions for authors
The paper is technically interesting. That said, several critical issues in the experimental design and implementation require further clarification or validation:
-
Appendix B describes ordering marker genes by cell-type specificity through , but how is specificity determined when a gene marks multiple populations? The authors should explain how ties, conflicting annotations, and missing markers are handled. Since this ordering defines the prototypes used for supervision, these choices affect both the biological interpretation and reproducibility of the method.
-
Curated marker databases may contain signatures derived from the same studies used for evaluation, allowing benchmark-derived information to enter post-pretraining. The authors should document the overlap between these resources and the evaluation studies, clarify whether evaluation-derived marker lists were excluded, and assess how excluding them affects performance.
-
CellRefine uses ground-truth cell-type labels to select marker prototypes, but it is unclear whether it outperforms an additional stage of ordinary supervised cell-type training under matched compute and data access. The existing contrastive and prototype controls are useful, but this comparison is still needed to establish what the biological structure adds beyond directly exploiting the same labels.
-
Explicitly separating closely related cell types may obscure continuous developmental transitions and within-type state variation, which are not fully represented by the ontology hierarchy. Improved classification and clearer UMAP clusters therefore do not establish that the underlying biological structure is preserved. Trajectory or differentiation analyses before and after lineage regularization would help determine whether these gains come at the expense of developmental continuity.