- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper investigates tokenization strategies for multicellular single-cell RNA-seq prediction tasks and introduces Module Distribution Encoding (MDE). Instead of representing individual genes or cells as separate tokens, MDE groups co-expressed genes into modules and summarizes each module's expression distribution across a population using zero-adjusted quantiles. This produces a fixed number of tokens independent of the number of input cells. The authors compare MDE against gene-level and cell-level tokenization approaches using a shared Transformer architecture across three tasks: patient-level disease classification, spatial niche composition prediction, and immune cell composition estimation. The results demonstrate substantial reductions in token usage, strong performance in disease prediction, and competitive performance in niche prediction, although cell-level tokenization performs better for cell composition estimation. Additional experiments examine module resolution and distribution encoding choices.
Critical strengths
- Efficient population-level representation.
- Useful comparative evaluation.
Critical weaknesses
-
Significant donor confounding in disease prediction. The disease benchmark uses cell-level splits within each donor because many disease categories occur in only one patient. Consequently, the training and test cohorts share donor identities, making it possible for models to exploit donor-specific transcriptional signatures rather than learn generalizable disease characteristics. This substantially weakens the interpretation of the nearly perfect disease classification results, which constitute one of the paper's main empirical findings.
-
Missing comparisons with simpler population-level aggregation methods. MDE is fundamentally a population-level summarization method, yet the main comparisons focus on gene-level tokenizers and per-cell Transformer inputs. Important alternatives, such as pseudobulk expression, mean/variance pooling, quantile aggregation without gene modules, and DeepSets-style pooling, are not evaluated. Without these baselines, it is difficult to determine whether the observed benefits arise from the proposed distributional encoding or from straightforward population aggregation.
-
Computational efficiency is not evaluated end to end. The claimed efficiency improvements are primarily measured through input token counts and an efficiency score based on performance divided by log token count. However, MDE still requires processing all cells, computing module scores, and estimating empirical quantiles before Transformer inference. The paper does not report wall-clock runtime, peak memory consumption, or the cost of token construction. Therefore, the practical computational benefits over simpler aggregation approaches are not sufficiently established.
-
Limited and task-dependent performance improvements. MDE substantially improves the reported disease classification results, but its advantage on spatial niche prediction is relatively small and inconsistent across cohort sizes. It also underperforms cell projection on cell composition estimation. Furthermore, the zero-adjustment ablation shows nearly identical performance without explicit zero adjustment for cohort sizes greater than one. These results suggest that the benefits of several proposed design choices are limited and that the broader advantages of distributional encoding require more careful qualification.
Questions for authors
-
Given that many disease labels occur in only one donor, could the authors provide the donor-to-disease distribution and evaluate whether a simple donor-identification baseline can explain the high disease prediction accuracy? This would help clarify the extent of donor confounding.
-
Could the authors compare MDE against simpler sample-level aggregation baselines, such as pseudobulk expression, mean/variance pooling, or distribution summaries without co-expression modules? These comparisons would help isolate the contribution of the proposed encoding.
-
Could the authors provide end-to-end runtime and memory comparisons that include module aggregation and quantile computation, rather than only Transformer token counts? This would strengthen the practical efficiency claims.