- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces scChromHEARTs, a model for learning cell representations from scATAC-seq. The encoder represents each genomic interval by rotating a chromosome embedding at its two boundaries and taking the difference. It then applies a chromosome-specific gate and bias based on the interval midpoint. A Transformer combines accessible intervals into a cell embedding. Pre-training uses a subset-view contrastive objective adapted from scRobust, along with region-accessibility prediction. The experiments cover cell-type annotation, batch-associated clustering, transfer between datasets from the same tissue, and a perturbation case study. The model achieves strong annotation results on several datasets and outperforms EpiAgent on most of the five transfer targets.
Critical strengths
-
The encoder uses chromosome identity and interval coordinates without a fixed region lookup table. This is useful when datasets have different peak definitions.
-
The paper evaluates several downstream tasks and includes component ablations. Table 1 shows competitive cell-type annotation results. Table 4 also shows promising transfer to unseen datasets from the same tissue.
Critical weaknesses
-
The advantage of the interval encoder remains unclear. Its main contribution is the combination of boundary rotations and midpoint gate/bias. The contrastive objective is adapted from scRobust, which already included a limited scATAC-seq application. Figures 3 and A7 provide useful ablations, but the token-plus-bias variant performs similarly on several datasets. Comparisons with simple coordinate encoders of similar size are still needed to justify this design. Figures 4 and A9 show organization by position and chromosome, but do not establish functional regulatory relationships. The biological interpretation of the learned “genomic structure” therefore needs stronger evidence.
-
Table 4 supports transfer between datasets from the same tissue, but does not directly test the claimed flexibility on new genomic regions. The paper reports neither the overlap between source and target peaks nor separate results for shared and unseen intervals. EpiAgent is the only comparator, and differences in pre-training make the source of the gains hard to assess. ARI and NMI are also selected at the best Leiden resolutions in a search range. This uses target labels to select the reported results and leaves performance under a fixed, label-free protocol unclear.
Questions for authors
-
How does the interval encoder compare with simpler alternatives, such as Fourier features of midpoint and width or a coordinate MLP? Please use the same Transformer, losses, input budget, and a similar parameter count. Does the lookup-table ablation reproduce scRobust, or just replace the region embedding in your pipeline?
-
In Table 4, what fractions of target intervals exactly match or overlap source intervals? Do all datasets use the same reference assembly? Results for shared and unseen intervals, or for altered peak boundaries, would help test the encoder's flexibility.
-
Could you add another representation baseline to Table 4 and report results under a fixed Leiden resolution? Please also explain how differences in pre-training may affect the comparison.
2 comments
I thank the authors for their response. They have addressed most of my concerns. I have raised my score to 3.
Response
Q1) Comparison with simpler coordinate-based embedders
Thank you for your suggestion. We conducted additional experiments comparing scChromHEARTs with two simpler coordinate-based embedders, Coordinate MLP and Fourier MLP, while maintaining the same Transformer backbone, pre-training objectives, and input budget, with closely matched embedding parameter counts.
As shown in the newly added Table A7 (Appendix G), scChromHEARTs consistently outperformed both alternatives across four datasets. For example, on PBMC, scChromHEARTs achieved an accuracy of 0.95 and a Macro-F1 of 0.84, compared with 0.67 and 0.38 for Fourier MLP, respectively. These results support the effectiveness of our structured interval embedding design beyond simpler coordinate encoding approaches.
We also clarify that the lookup-table ablation does not reproduce the full scRobust framework; it replaces only the genomic region embedding module within our pipeline.
We have included these findings in the revised manuscript (Page 9, Lines 472–479; Appendix G, Table A7).
W2 & Q2–Q3) Cross-dataset transferability and genomic interval sharing
Thank you for your suggestions. We expanded the cross-dataset transferability evaluation by adding PeakVI and PoissonVI as additional baselines, using shared cCRE features to ensure consistent input spaces for these VAE-based methods. To avoid target-label-based optimization, Leiden resolutions were selected exclusively on the training datasets and then fixed when applied to unseen evaluation datasets without further tuning.
We also clarified the differences in pre-training: EpiAgent was initialized from a large-scale human scATAC-seq pretrained model and subsequently trained on the tissue-matched dataset, whereas scChromHEARTs was trained only on the tissue-matched dataset without human corpus pre-training. As shown in the updated Table 4, scChromHEARTs achieved the highest average ARI/NMI on Lareau2019 (0.671) and Hocker2021 (0.803), demonstrating competitive cross-dataset transferability despite using less pre-training data.
Furthermore, we quantified genomic interval sharing between source and target datasets. As shown in Table A8 (Appendix H), 70.09–83.56% of active target intervals exactly matched source intervals, while 16.44–29.91% were source-unseen. All datasets used the same GRCh38/hg38 reference assembly and a shared cCRE dictionary. While these results characterize the extent of genomic region differences across datasets, performance on source-unseen intervals and robustness to altered peak boundaries remain to be evaluated separately.
We have included these analyses and clarifications in the revised manuscript (Page 8, Lines 398–427; Table 4; Appendix H, Table A8).