- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper uses the DINOv2 framework for self-supervision to learn representations for scRNA-seq data, which is tabular data. The proposed model improves performance with respect to classic baselines, which was not reported by other papers before. The experimental results were obtained with a corpus of data curated by the authors, and then three subsets are used for evaluation.
Critical strengths
- The paper shows that self-supervised learning using self-distillation algorithms improves performance with respect to classical baselines.
Critical weaknesses
- The paper was written with heavy use of AI, resulting a confusing manuscript that requires too much effort to follow and understand. It has no global coherence and reports either trivial facts summarized from sources or trivial data interpretations without sufficient explanation. The paper lacks the proper voice of scientists and has no well developed motivations, explanations, and interpretations of the results. It is a well conducted and well documented experiment, but it is not a fully developed scientific manuscript for this conference.
- On the technical side, the paper adapts the DINOv2 framework for tabular, scRNA-seq data, but it lacks technical innovation. All the algorithmic elements introduced in the paper are mainly taken from the existing DINOv2 implementation, including the student-teacher loss, and the KoLeo regularizer. The Sinkhorn equipartition is known in the SSL literature as well, and was just added to the existing framework.
- There is no reasoning or explanation for why the architecture was chosen. Presumably, the authors were motivated by the previous use of linear models for sequencing data. But other competing models that they cite use transformer networks, and there is no rational for using their models, nor experiments that evaluates their choice.
- The contributions and novelty are limited. Beyond improving performance with respect to classical baselines, there is no major technical or conceptual contribution in this paper. The experiments are limited to comparing to baseline methods and the ablations or other evaluations to understand the methods or data are limited.
- Missing critical baselines. No comparisons with Cell-JEPA and GeneJEPA are reported despite the fact that these are direct competitors with the proposed method. Also, they presented an evaluation with their own curated data. Why not adopt existing datasets and data partitions to report results comparable to previous literature?
Questions for authors
- Can the authors make the effort of writing the paper in their own voice? Communication is one of the main building blocks of the scientific method, and if the authors are unable to explain their research, the manuscript cannot be published in this conference.
- Why were Cell-JEPA and GeneJEPA left out of the evaluation?
- Why was that architecture chosen?