- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces a method that represents each single-cell transcriptome as one discrete state on each of 32 programme axes. It combines per-axis vector quantization, a cell-type/donor-derived gene-responsibility scaffold, and an additive decoder whose axis-state outputs define signed gene-effect vectors.
Critical strengths
- The compositional discrete representation is conceptually interesting.
- The method is described clearly.
Critical weaknesses
- If I understand it correctly, the scaffold incorporates cell-type labels, so agreement with known programmes does not alone establish de novo discovery. Maybe it would be better to quantify how much the biological-coherence results depend on the scaffold.
- Baseline factors are selected within donor-held-out folds, to me it is unclear when LEXA’s Axis 10 and codes C2/C12 were chosen. Can the authors clarify the selection procedure and repeat the comparison with fold-nested selection for every method.
- Severity-associated states are identified and assessed in COVID-A, without independent-cohort replication of their association directions. Applying the frozen atlas model demonstrates representation transfer, but does not validate those clinical associations.
Questions for authors
- Were the underlying models fitted without the held-out donors, and were LEXA’s axis, codes, and gene lists selected within each fold, as the comparator factors were? If not, how does a fully nested comparison affect the concordance ranking?
- Can you repeat GO coverage, fragmentation, monocyte concordance, and state interpretation, not merely macro-F1 and reproducibility, for the model without the cell-type-derived scaffold?
- Do the COVID-A severity-associated states replicate in COVID-B using a frozen lexicon, pre-specified state mappings, effect directions, and one correction family?
- What was the prespecified primary family of COVID-A severity tests, and do the principal associations survive correction across the cell classes and representation families discussed as one result?
- How many independent donors enter each regression, and are results robust to estimated dispersion, HC3 or bootstrap uncertainty, nonlinear severity effects, and site-stratified analysis?
- What identifies an axis-state gene contribution uniquely, given that reconstruction can redistribute signal among soft gene responsibilities, codebooks, FiLM parameters, and the shared decoder?
- What are the empirical code entropies, state occupancies, dead-code rates, and stability of assignments across seeds and cohorts, rather than the nominal 128-bit capacity based on all states being usable?
7 comments
Authors — Response (Part 2/5)
Response to W2 & Q1: Fairness of monocyte comparisons and fully nested selection
We thank the reviewer for raising this important concern about potential selection bias. We clarify that the illustrative states shown in Figure 4B and the quantitative donor-held-out benchmark serve different purposes and follow different selection procedures.
Illustrative states versus quantitative evaluation. The A10 and related states from the reference model (seed 6101) are used as illustrative examples in Figure 4B. In contrast, the quantitative benchmark does not rely on these predefined states. Instead, each method independently selects its native programme objects within each outer donor fold, using only the remaining four folds for selection.
All representation models were fitted on 56,333 OneK1K training cells, with no donor overlap between model training and the donor-disjoint test partition used for the monocyte evaluation. Within each outer fold, candidate objects were ranked by their standardized CD16-versus-CD14 activity difference using the four discovery folds. For LEXA, candidates are its native axis-state objects; for continuous programme models, candidates are their native factors or topics. The most CD16-associated and CD14-associated objects were selected separately before evaluating their molecular concordance in the held-out donor fold.
As shown in Table 2, the selected LEXA objects are highly consistent across the five donor folds within individual model fits. For example, the reference seed 6101 consistently selects A10 for CD16 and A10 for CD14 across all five folds. Importantly, all selections are performed without access to the held-out fold.
Table 2. Native LEXA objects selected within the five donor folds.
| Fit | CD16-associated native object | CD14-associated native object |
|---|---|---|
| Reference seed 6101 | Axis 10 C2 (5/5) | Axis 10 C12 (5/5) |
| Seed 6102 | Axis 21 C3 (5/5) | Axis 16 C5 (5/5) |
| Seed 6103 | Axis 21 C9 (5/5) | Axis 26 C6 (5/5) |
| Atlas-mask scaffold | Axis 23 C10 (3/5); Axis 26 C9 (2/5) | Axis 19 C15 (5/5) |
| KMeans scaffold | Axis 23 C14 (5/5) | Axis 23 C0 (5/5) |
Fully nested molecular concordance. We then evaluated all methods on the same complete 10,310-gene space, avoiding differences in gene-set selection across methods. As shown in Table 3, LEXA achieves the highest Pearson correlation for CD16 monocytes (0.238), compared with 0.142 for cNMF, 0.162 for LDA, and 0.180 for Spectra. For CD14 monocytes, LDA achieves the highest correlation (0.281), while LEXA achieves 0.200.
Table 3. Fully nested monocyte Pearson correlation over the common 10,310-gene space.
| Native object | CD16 Pearson | CD14 Pearson |
|---|---|---|
| LEXA states | 0.238 | 0.200 |
| cNMF factor | 0.142 | 0.236 |
| LDA topic | 0.162 | 0.281 |
| Spectra factor | 0.180 | 0.135 |
Response to W3 & Q3, Q4, Q5: Independent cross-cohort validation of COVID-19 severity associations
We thank the reviewer for raising these important concerns regarding the reproducibility and statistical reliability of our COVID-19 severity associations. We address the three questions separately below.
(1) Multiple-testing correction across severity associations (Q4)
We acknowledge that the original analysis applied BH correction separately within cell-class-by-representation families. To address Q4, we repeated the analysis using a single pooled BH correction across all 5,452 eligible linear severity tests, including 39 cell-subtype tests, 1,766 atlas-state tests, and 3,647 cohort-fitted-state tests.
As shown in Table 4, 2 subtype associations, 133 atlas-state associations, and 212 cohort-fitted-state associations remain significant after this correction. These results demonstrate that substantial disease-associated molecular variation remains detectable even after controlling the false discovery rate across all cell classes and representation families in one testing family.
Table 4. COVID-A severity associations after one pooled BH correction across all 5,452 linear tests.
| Representation family | Tests | Significant after pooled BH |
|---|---|---|
| Subtype | 39 | 2 |
| Atlas LEXA | 1,766 | 133 |
| Cohort-fitted LEXA | 3,647 | 212 |
Authors — Response (Part 3/5)
(2) Independent donors and robustness of statistical inference (Q5)
To address Q5, we clarify that the donor, rather than the individual cell, is the independent statistical unit. We retained only the earliest available sample per individual, resulting in 83–86 independent donors per major cell class, as detailed in Table 5.
Table 5. Independent COVID-A donors entering each major-cell-class regression.
| Cell class | Independent COVID-A donors |
|---|---|
| B cell | 83 |
| CD4 T | 85 |
| CD8 T | 85 |
| Dendritic cell | 86 |
| Monocyte | 86 |
| NK / ILC | 86 |
| Plasma / plasmablast | 84 |
| Platelet / MK | 86 |
| Unconventional T | 85 |
We further examined the robustness of the 20 fixed CD4-associated states shown in Figure 5B. All 20 associations retain nominal significance (p < 0.05) under HC3 robust covariance estimation and jointly estimated negative-binomial dispersion. All 20 donor-bootstrap percentile confidence intervals exclude zero across 500 resamples. In addition, site-stratified analyses yield coefficients consistent in direction with the pooled estimates for all 20 states in both Cambridge and Newcastle (Table 6). These analyses demonstrate that the principal CD4 associations are robust to alternative uncertainty estimates, dispersion assumptions, and recruitment-site stratification.
Table 6. Robustness checks for the 20 fixed Figure 5B CD4 associations.
| Check | Result |
|---|---|
| HC3 covariance, fixed Figure 5B CD4 states | 20/20 associations retain p<0.05 |
| Jointly estimated negative-binomial dispersion | 20/20 associations retain p<0.05 |
| 500 donor bootstrap resamples | 20/20 percentile intervals exclude zero |
| Site-stratified models | 20/20 coefficients retain the pooled direction in Cambridge and Newcastle |
(3) Nonlinear severity effects (Q5)
The reviewer also asks whether the severity associations are robust to nonlinear effects. We therefore extended the regression models by adding a centred quadratic severity term and applied one BH correction across all 5,452 quadratic-term tests.
Five quadratic associations remain significant after correction (q < 0.05), including two atlas states and three cohort-fitted states (Table 7). These associations exhibit non-monotonic patterns across the five severity levels, including inverted-U-shaped and U-shaped relationships. These results extend the original linear severity analysis by identifying additional molecular configurations associated with nonlinear disease responses.
Table 7. Quadratic severity associations significant after one BH correction across all 5,452 tests.
| Cell class | Representation | State | Quadratic β | Raw quadratic p | Global quadratic BH q | Fitted pattern |
|---|---|---|---|---|---|---|
| Unconventional T | Atlas LEXA | A6:C11 | −0.3899 | 7.685e−07 | 0.001397 | Inverted U |
| Dendritic cell | Atlas LEXA | A6:C8 | 0.3281 | 5.203e−06 | 0.007092 | U-shaped |
| Monocyte | Cohort-fitted LEXA | A23:C11 | −0.2630 | 5.550e−09 | 3.026e−05 | Inverted U |
| Monocyte | Cohort-fitted LEXA | A30:C13 | −0.2338 | 2.086e−07 | 5.686e−04 | Inverted U |
| Dendritic cell | Cohort-fitted LEXA | A2:C1 | −0.3289 | 4.335e−05 | 0.04727 | Inverted U |
(4) Independent cross-cohort validation of severity-associated molecular signatures (W3 & Q3)
To address W3 and Q3, we performed independent cross-cohort validation of the molecular signatures associated with disease severity, rather than relying solely on the transferability of the pretrained representation.
In COVID-A, we identified significant severity-associated programmes using donor-level negative-binomial regression, adjusting for age, sex, site, and days from symptom onset, with a cell-count offset and the pooled multiple-testing correction described above. The resulting significant programmes were converted into direction-oriented molecular signatures using their top 50 and bottom 50 genes. These gene sets and their association directions were frozen before evaluation in COVID-B.
Importantly, COVID-A and COVID-B have different clinical designs. COVID-A supports a five-level severity analysis, whereas COVID-B contains only 14 acute cases and lacks moderate and critical acute donors. Therefore, the original five-level severity coefficient cannot be directly replicated in COVID-B. Instead, we tested whether the frozen molecular signatures retained their prespecified disease-association directions under the available acute COVID-19 versus healthy comparison.
Authors — Response (Part 1/5)
We sincerely thank the reviewer for the careful and insightful assessment. To present our additional analyses clearly within OpenReview’s character limit, we have divided our response into five consecutive comments (Parts 1–5). These address scaffold dependence, donor-level selection and independent validation. We evaluate an annotation-free scaffold, a fully nested monocyte analysis, a pooled COVID-A correction family and cross-cohort validation.
Response to W1 & Q2: Dependence of biological interpretability on the scaffold
We appreciate the reviewer's concern that the cell-type-derived scaffold may influence the biological interpretation of the learned programme states. We therefore evaluated the dependence on scaffold construction using programme-level and molecular endpoints, rather than cell-type classification alone.
We first clarify that the scaffold is used to initialize gene responsibilities, which are subsequently updated during training rather than held fixed. In addition to the original OneK1K-derived scaffold, we constructed two alternatives: (1) an atlas-derived scaffold based on CELLxGENE and (2) an annotation-free scaffold in which cell-type contrasts are replaced with unsupervised KMeans strata. We trained LEXA on OneK1K with these different scaffold initializations and evaluated fine-cell-type information retention, held-out age-associated molecular prediction, and GO programme organization.
As shown in Table 1, the annotation-free KMeans scaffold achieves comparable performance to the original model, with fine-type MLP scores of 0.614 versus 0.620, age-associated-expression Pearson correlations of 0.698 versus 0.701, and identical GO programme coverage of 0.750. Notably, its fragmentation is lower (0.156 versus 0.300). The atlas-derived scaffold similarly maintains or improves performance across these evaluations.
These results suggest that LEXA's ability to recover biologically coherent programmes is not solely driven by the original cell-type-derived scaffold. Even when cell-type annotations are excluded from scaffold construction, the model retains comparable programme coverage and held-out molecular prediction performance.
Table 1. OneK1K cohort-fitted LEXA under alternative scaffold initializations.