- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Hi-Cell, a cell-level foundation model for single-cell Hi-C analysis. The method represents chromatin contact maps using hierarchical cell, chromosome, and multiscale patch tokens, which are jointly processed by a Transformer to capture local and global chromatin organization. The authors also construct Human-Hi-C-Corpus, comprising approximately 324k single cells and 357 bulk Hi-C experiments, and propose a three-stage pretraining strategy incorporating real single-cell data, bulk-derived pseudo-single cells, and cross-depth reconstruction. The model is evaluated on six external scHi-C datasets for cell clustering, cell-type annotation, and contact imputation. Results demonstrate competitive zero-shot representations, improved clustering after label-free fine-tuning, and strong zero-shot contact reconstruction across sequencing depths. Additional experiments investigate the benefits of pretraining and multiscale representations.
Critical strengths
- Large-scale foundation modeling for an underexplored modality.
- Strong and comprehensive empirical results.
Critical weaknesses
-
Incomplete comparison with closely related methods. Although the paper discusses HiCFoundation and other recent Hi-C modeling approaches, the main experiments primarily compare against traditional scHi-C methods such as Higashi and scHiCluster. A direct comparison with HiCFoundation, or a clearer explanation of why its single-cell applications cannot be evaluated under the same protocols, would better establish the contribution relative to existing foundation models.
-
Insufficient ablations of the progressive pretraining strategy. The authors compare the initial single-cell-only checkpoint against the final model, but do not separately isolate the contributions of bulk-derived pseudo-single-cell supervision and cross-depth refinement. Consequently, the relative importance of the three training stages remains unclear. Matched-budget ablations would help establish whether the proposed progressive strategy is necessary.
-
Potential reliability issues in baseline evaluation. The supplementary annotation results reveal unusually large performance drops for scHiClassifier in individual folds, such as Kim2020 and Wu2024, which substantially reduce its aggregate performance. These results raise questions about baseline training stability and whether the reported comparisons accurately reflect its achievable performance. Further clarification or verification of these folds would strengthen the evaluation.
-
Limited resolution and computational efficiency analysis. The model operates at 1 Mb resolution and considers only intrachromosomal contacts, limiting its applicability to finer genomic structures and interchromosomal interactions. Moreover, the approximately 594M-parameter architecture introduces substantial computational overhead, but inference cost, memory consumption, and scalability are not systematically compared with existing approaches. These limitations affect the practical significance of the proposed framework.
Questions for authors
-
Could the authors clarify why HiCFoundation is not included in the main evaluation? Is there an applicable pretrained configuration or evaluation setting that would allow a more direct comparison?
-
Could the authors provide separate results after Stage II and Stage III, or a comparison that removes pseudo-single-cell supervision while maintaining a comparable training budget? This would help establish the contribution of the individual pretraining components.
-
Could the authors clarify the unusually low scHiClassifier scores in certain annotation folds, particularly Kim2020 and Wu2024? Were these caused by training instability, convergence failures, or other factors?
-
Could the authors report approximate inference time and GPU memory requirements for Hi-Cell relative to the strongest baselines? This would help assess the practical tradeoff between model complexity and performance.
3 comments
Response to Reviewer PUth (Part 2/2)
3. Reliability of scHiClassifier evaluation
We appreciate the reviewer's careful examination of the fold-level annotation results. We used the authors' publicly released scHiClassifier implementation and its training procedure, with the same canonical cells and stratified five-fold test splits as the other annotation baselines.
To investigate the reported results, we audited the saved predictions, fold assignments, labels, and training histories across all 30 scHiClassifier folds and reproduced the reported scores. The two folds highlighted by the reviewer exhibit highly concentrated predictions:
| Dataset / fold | Prediction behavior | Accuracy | Macro-F1 |
|---|---|---|---|
| Kim2020, fold 4 | 1,367/1,579 cells predicted as HFF | 0.1305 | 0.0966 |
| Wu2024, fold 3 | All 86 cells predicted as BJ | 0.1512 | 0.0657 |
The saved training history for Wu2024 shows a sharp increase in training loss after approximately 380 epochs, while the reported predictions were obtained from the fixed 420-epoch checkpoint. This behavior is consistent with late-stage training instability under the adopted training procedure, although its precise cause remains undetermined.
Hi-Cell's annotation performance is also supported by an independent comparison with logistic regression. Under the same five-fold evaluation framework, frozen Hi-Cell embeddings with an MLP readout achieve a mean macro-F1 of 0.8569, compared with 0.8047 for logistic regression, an improvement of 5.22 percentage points. This provides additional evidence for the effectiveness of Hi-Cell's transferable cell representations.
We will include these audit findings in the revised manuscript.
4. Computational efficiency and scalability.
We thank the reviewer for highlighting the importance of computational efficiency and practical applicability. We profiled Hi-Cell, HiCFoundation, and Higashi across six external datasets using matched 10k-contact inputs and the same GPU within each dataset.
The following table reports whole-cohort contact imputation times. Hi-Cell and HiCFoundation reuse pretrained checkpoints without target-dataset fitting, whereas Higashi follows its native target-specific fitting and neighbor-imputation pipeline.
| Dataset | Cells | Hi-Cell inference (s) ↓ | HiCFoundation inference (s) ↓ | Higashi fitting (s) | Higashi inference (s) |
|---|---|---|---|---|---|
| Ramani2017 | 64 | 0.30 | 32.23 | 3,250.65 | 14.84 |
| Lee2019 | 3,896 | 18.23 | 3,176.84 | 2,442.72 | 1,041.42 |
| Kim2020 | 97 | 0.86 | 45.63 | 3,137.12 | 67.74 |
| Chang2024 | 84 | 0.31 | 37.04 | 2,323.50 | 18.09 |
| Wu2024 | 428 | 1.56 | 224.09 | 2,598.42 | 98.67 |
| Zhou2024 | 837 | 7.11 | 391.21 | 2,936.39 | 624.06 |
Hi-Cell achieves the lowest native-pipeline inference time on all six cohorts. For the 3,896-cell Lee2019 dataset, Hi-Cell completes imputation in 18.23 seconds, compared with 3,176.84 seconds for HiCFoundation. Higashi requires 2,442.72 seconds of target fitting followed by 1,041.42 seconds of prediction, in addition to setup. These results highlight the deployment advantage of reusable pretraining, enabling efficient analysis of new cohorts without dataset-specific encoder fitting.
GPU memory requirements are also practical: on Lee2019, Hi-Cell uses 3.01 GiB of peak allocated memory at cell batch size 64, compared with 1.39 GiB for HiCFoundation at window batch size 16 and 1.13 GiB for Higashi's required native workflow. The methods use their respective batching interfaces.
Regarding resolution, Hi-Cell operates at 1 Mb across chromosomes 1–22 and X, modeling genome-wide intrachromosomal contacts. This shared coordinate system enables transferable cellular representations and chromosome-scale structural reconstruction across heterogeneous datasets. We will clarify this modeling scope and discuss extensions to finer-resolution and interchromosomal contact modeling in the revised manuscript.
We will incorporate the resource measurements and their evaluation protocols into the revised manuscript.
Thank you for the rebuttal. I've raised my score accordingly.
Response to Reviewer PUth (Part 1/2)
We appreciate the reviewer's positive feedback on the value of foundation modeling for scHi-C and the breadth of our empirical evaluation. In response to the reviewer's constructive comments, we have conducted a direct comparison with HiCFoundation, expanded our pretraining ablations, systematically audited the scHiClassifier results, and performed additional analyses of inference efficiency and GPU memory usage. We also provide further clarification of Hi-Cell's 1-Mb intrachromosomal modeling scope.
1. Direct comparison with HiCFoundation
We thank the reviewer for highlighting the importance of comparison with existing Hi-C foundation models. HiCFoundation provides official pretrained configurations that support evaluation on our downstream tasks, and we have now completed this direct comparison.
Our original benchmark focused on methods specifically designed for cell-level scHi-C analysis, whereas HiCFoundation primarily learns genomic-region representations from contact windows and aggregates them for downstream applications. Hi-Cell instead directly learns whole-cell representations by jointly modeling cell-, chromosome-, and multiscale patch-level information. This difference in pretraining focus motivated our initial baseline selection.
Following the reviewer's suggestion, we evaluated HiCFoundation using its official pretrained encoder for clustering and annotation and its official single-cell checkpoint for contact imputation, preserving its native preprocessing and representation aggregation.
Clustering and annotation use frozen pretrained representations, with the same supervised readout protocol for annotation. For imputation, both methods are evaluated at 10k, 25k, and 50k contacts per cell on the same 14-chromosome support; Hi-Cell predictions and references are recomputed accordingly.
Hi-Cell achieves higher mean performance across all six metrics, demonstrating its effectiveness in transferring cellular representations and structural priors to unseen datasets. Notably, the same pretrained Hi-Cell checkpoint supports clustering, annotation, and zero-shot contact reconstruction without target-dataset encoder fitting.
2. Contributions of pseudo-single-cell supervision and cross-depth refinement
We thank the reviewer for the insightful suggestions. We conducted additional stage-wise and matched-budget ablations to separately examine the contributions of bulk-derived pseudo-single-cell supervision and real-cell cross-depth refinement.
All continuations start from the same Stage-I checkpoint pretrained on real single-cell Hi-C data. Stage II introduces pseudo-single-cell-to-bulk reconstruction, and Stage III introduces binomial thinning of real-cell inputs for cross-depth reconstruction.
All results are six-dataset means; imputation averages 10k/25k/50k contacts per cell on the original 23 chromosomes. Stage II and Stage III use 125,600 and 30,720 updates, respectively.
Bulk-derived pseudo-single-cell supervision provides substantial structural reconstruction benefits. Under the same Stage-II training budget, mixed real/pseudo supervision achieves a mean LOO SCC of 0.7392, compared with 0.6532 for real-only training. After the complete continuation, Full Hi-Cell reaches 0.7460, compared with 0.6843 when pseudo-single-cell supervision is removed throughout Stages II and III. This demonstrates that the structural gains cannot be explained simply by additional real-cell optimization.
Real-cell cross-depth refinement provides further improvements. Removing binomial thinning from Stage III, while retaining the mixed-supervision Stage-II initialization, yields held-out SCC and LOO SCC of 0.3457 and 0.7432, respectively, compared with 0.3478 and 0.7460 for Full Hi-Cell. The complete recipe also improves mean clustering NMI from 0.6105 after Stage II to 0.6423 after Stage III.
Together, these experiments demonstrate the complementary roles of real-cell pretraining, bulk-derived structural supervision, and real-cell cross-depth refinement.