- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies distribution regularization for learning shared representations across single-cell technologies. A count-reconstruction model combines technology-specific modules with a shared latent bottleneck. Quantile matching aligns coordinate marginals, while a smooth-rank kernel discrepancy aligns inter-coordinate dependence. The method assumes comparable captured biological populations across technologies and uses a soft total-variance penalty to discourage global shrinkage. Experiments examine simulated factor recovery, real-data integration, held-out donor protein prediction, and robustness to population differences. Results indicate task-dependent benefits alongside losses in biological geometry. Separate stability audits and selection-shift experiments identify limitations in interpreting individual coordinates and applying alignment when captured populations differ.
Critical strengths
- Separating marginal distributions from inter-coordinate dependence makes the alignment target explicit. Comparing six alignment objectives within the same reconstruction backbone provides useful evidence about their distinct effects and trade-offs.
- Independent simulation generators support factor-recovery gains under comparable populations, and confirmation cohorts show clustering improvements. The paper also documents selective-capture failures and unsuccessful factor interpretation, providing meaningful boundaries on the method's applicability.
Critical weaknesses
- Shrinking selected coordinates relative to the fixed smooth-rank bandwidth can lower the discrepancy without changing exact ranks, while other coordinates satisfy the total-variance floor. The normalized marginal diagnostics and exact-rank improvements are useful, but do not establish that training avoids this failure mode.
- Consistent transfer-F1 gains are not established on the confirmation cohorts, and protein prediction lacks a marginal-only control and site-independent testing. No combined-model factor passes the semantic audit. Unexplained differences between Tables 9 and 13, unavailable reproducibility artifacts, and verified bibliographic errors further weaken confidence in the evidence.
- Lots of citation errors. Harmony lists Nathan instead of Nghia Millard; Kunes et al. lists Robert C. instead of Russell Z. Kunes; scETM lists Qianxi instead of Jian Tang; scCRAFT lists Panagiotis instead of Paraskevas Filippidis; and Hrovatin et al. omits Shrey Parikh from an otherwise unabridged author list.
Questions for authors
- The fixed-bandwidth smooth-rank loss can decrease when selected coordinates shrink, even if exact-rank dependence is unchanged and the total-variance floor is satisfied. Table 15 normalizes marginal discrepancies but does not isolate this dependence-loss failure mode. Do the downstream gains persist when training prevents coordinate-wise rescaling from reducing the dependence loss?
- Table 2 reports improved protein prediction for combined alignment over no alignment, but does not include the marginal-only model. The contribution of dependence matching to this result is therefore unresolved. How much protein-prediction improvement remains over marginal alignment alone under the identical donor split and probe protocol?
- Both BMMC test donors come from acquisition site 4, which is also represented in training, and acquisition site defines the model's technical batches. The current result therefore measures donor transfer within a represented site. What evidence supports extending the protein-prediction benefit to an acquisition site excluded from representation and probe training?
- Table 5 shows substantial cross-technology cell-type composition differences, while the selective-capture experiments demonstrate that alignment can suppress genuine biological variation. What evidence establishes that the integration gains on the real cohorts preserve biological population differences rather than remove them?
- The combined model has mean iLISI of 0.374 in Table 9 and 0.425 in Table 13, although the no-alignment and marginal-only rows agree across tables. The reproducibility package is not yet available. What run-level provenance explains this discrepancy in the reported primary-model results?
2 comments
How much of a known population difference survives alignment?
We added a real-cell experiment that measures the loss of a known composition difference directly. We imposed a 38.75-percentage-point difference in CD4 T-cell prevalence between Chromium and Quartz-Seq2 using CD4 T and HEK cells from GSE133549. Across five fits on the same split, a cross-technology classifier recovered 24.5 points without alignment, 16.2 with program-wise marginal alignment alone, and 14.6 with full PSDR. Over the same comparisons, same-type cross-technology MMD² improved from 0.493 to 0.209 to 0.173. Thus, most of the additional attenuation relative to the unaligned fit was already present with marginal alignment alone.
Full PSDR-C recovered 14.3 points. The loss was visible in a specific population: the classifier correctly identified 77.5% of held-out Quartz-Seq2 HEK cells, compared with 92.5% without alignment. The held-out RNA supported the distinction between the two groups. CD3D was detected in 90% of annotated CD4 T cells and 2.5% of HEK cells, while KRT18 was detected in 5% and 90%, respectively. Holding the fitted PSDR-C scores and backgrounds fixed, the final calibration changed the recovered gap only from 14.6 to 14.3 points. Most of the attenuation in the full model therefore preceded that step.
For Q4, the five-seed result qualifies the integration claim: alignment improved same-type agreement while making a genuine prevalence difference less recoverable. The aggregate integration gains on the observational cohorts cannot by themselves establish preservation of their population differences (revised Appendix F.13, Table 25).
Response to reviewer kLqG: targeted controls, generalization and reproducibility
Thank you for recognizing the controlled comparisons and for identifying specific issues requiring further evidence. We address each question below and distinguish results for the submitted model from later revisions.
Q1 — Does the benefit survive removal of the rescaling shortcut?
Yes, for clustering on the three tested cohorts. We agree that fixed-bandwidth smooth ranks are scale-sensitive and that the total-variance floor does not exclude coordinate-wise shrinkage.
We tested a targeted modification: within each technology, center each coordinate and apply max-absolute prescaling followed by unit-RMS normalization before computing smooth ranks. Only the dependence branch changes; reconstruction and marginal alignment retain the original coordinates. For nonconstant coordinates in exact arithmetic, positive rescaling cannot reduce this dependence loss.
Five paired optimization seeds on fixed splits give: Cohort ARI gain over marginal-only Positive seeds ARI gain over no alignment GSE +0.0644 ± 0.0506 5/5 +0.0467 ± 0.0468 Ding +0.0671 ± 0.0524 5/5 +0.0214 ± 0.0355 Pancreas +0.0599 ± 0.0244 5/5 +0.1032 ± 0.0509
Values are paired mean differences ± sample SD, not biological replication. GSE uses the Table 13 supplementary training implementation. These are endpoint-specific gains: on pancreas, biological ASW and transfer F1 versus marginal-only change by −0.0304 and −0.0153. This intervention shows that clustering gains need not depend on the specified shortcut; it does not prove that the original training never exploited it or exclude constant-coordinate collapse.
Q2 — Protein prediction versus marginal-only alignment
We added the requested comparison under the identical donor split and protein-probe protocol. The combined-minus-marginal median paired per-protein ΔR², averaged over five seeds, is +0.00103 ± 0.01069, positive in 2/5 seeds. Thus, the submitted combined-versus-none result does not establish a stable dependence-specific protein gain. We distinguish whole-representation predictive utility from the incremental contribution of dependence matching.
Q3 — Transfer to an excluded acquisition site
The submitted experiment tests new donors at a represented site. In an additional experiment, all site-4 cells were excluded from source feature selection, representation training and probe training. Unseen-site inference used a new, fixed equal-weight ensemble of source encoders, without target-RNA calibration.
Combined-minus-none median paired ΔR² is +0.00570 ± 0.00762 over five seeds, positive in 4/5; the donor-specific mean differences are +0.01347 and approximately zero. Combined-minus-marginal is +0.00411 ± 0.01447, positive in 3/5. These provide limited evidence for one excluded site under this additional inference protocol, not general native unseen-site capability.
Q4 — Preservation of biological population differences
We do not infer biological preservation from improved mixing. As clarified in revised Section 5.1 and Appendix B.6, the assumption concerns latent program-state distributions. Different cell-type proportions need not change every program's marginal, but can change background-associated programs and the joint distribution. The submitted objective does not automatically identify invariant programs or solve population mismatch.
We retain the negative selection-shift results and the 0/64 semantic-audit outcome. Stable biological program discovery and uniform transfer-F1 gains are not claimed. Applicability requires sampling metadata and independent biological evidence; alignment itself cannot certify that genuine population differences were preserved.
Q5 — Table 9/Table 13 provenance
The combined rows use separate checkpoint sets from the primary and supplementary training implementations. Five-seed reruns reproduce their respective mean iLISI values, 0.373691 and 0.424604. They are not two summaries of identical checkpoints.
A seed-7 intervention replacing the supplementary loss assembly with the primary expression reproduces Table 9's iLISI of 0.399365 rather than Table 13's 0.410314. This identifies a concrete implementation sensitivity in that run; we do not claim that the single-seed intervention establishes the complete mechanism across all seeds. We acknowledge that the original presentation did not adequately distinguish these runsets.
Bibliography and reproducibility
The revised bibliography corrects Nghia Millard, Russell Z. Kunes, Jian Tang and Paraskevas Filippidis, and includes Shrey Parikh. We apologize for these author-metadata errors.
The revision now includes the anonymous repository link. This supplies the project address; we do not equate providing a link with independently verified reproduction of every experiment.