- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether single-cell profiles generated from patient bulk RNA-seq can recover cell-type-specific disease-associated differential expression signals detected in measured single-cell data but missed by bulk analysis. The authors propose two main components: (1) an agentic benchmarking workflow for cohort auditing, literature-based disease-gene evidence retrieval, and patient-level DEG recovery evaluation; and (2) a patient-conditioned single-cell generation framework that uses a Patient Bulk Encoder (PBE) to condition a CFGen-based flow-matching generator with a count decoder, followed by a Bulk-Conditioned Shift (BCS) module to adjust patient- and cell-type-specific gene expression.
Experiments on three paired bulk/scRNA-seq disease cohorts show improved recovery of important bulk-missed DEGs compared with the evaluated generative models and mean-prediction baselines in some settings. Ablation studies indicate that BCS contributes substantially to the observed improvements. The enhanced agentic workflow retrieves more disease-associated gene evidence than the original retrieval procedure.
Critical strengths
-
Patient-conditioned single-cell generation. The paper extends a CFGen-based generator with a bulk-derived Patient Bulk Encoder (PBE) and a Bulk-Conditioned Shift (BCS), enabling single-cell generation for unseen patients using only their bulk RNA-seq data. The design addresses a relevant inference setting.
-
Biologically relevant evaluation. The paper evaluates whether generated single-cell profiles can recover cell-type-specific disease signals detected in measured single-cell data but missed by paired bulk RNA-seq. The use of paired bulk/scRNA-seq data and literature-supported DEG references provides a biologically meaningful framework for assessing the utility of generated single-cell profiles in disease-related analyses.
Critical weaknesses
-
Insufficient evaluation of the model design and generated results. The generative framework builds on CFGen with the addition of PBE and BCS, but the effectiveness of these components is not thoroughly evaluated. The contribution of PBE is not adequately isolated through matched ablation studies. Although BCS improves DEG recovery, it remains unclear whether it recovers missing patient-specific signals or potentially amplifies those already captured by the generator. More importantly, the evaluation focuses predominantly on cell-type-level DEG recovery, with limited assessment of generated single-cell expression distributions, cell-to-cell heterogeneity, and cell-state distributions. Furthermore, since DEG significance depends on both between-group expression differences and within-group variability, the accuracy of generated patient-level expression variance also requires further investigation to rule out potentially inflated significance. Finally, comparisons with established cell-type-specific expression deconvolution methods are missing.
-
Limited reproducibility and experimental transparency. The incomplete documentation of source datasets and participant-level data splits makes it difficult to verify data independence and reproduce the experiments. In addition, the historical agentic benchmarking experiments lack complete records of prompts, model/tool versions, retry budgets, search costs and human interventions, preventing full reproduction of the retrieval workflow. Several implementation details of the generative framework, including the flow-matching architecture and inference settings, are also insufficiently specified, and no source code is provided to clarify these details.
Questions for authors
-
Since the primary objective of this work is to generate single-cell profiles from bulk RNA-seq, evaluating the quality of the generated cells is essential. However, the current evaluation focuses predominantly on cell-type-level DEG recovery. Can the authors provide quantitative comparisons between generated and measured single-cell data, particularly in terms of gene expression distributions, cell-to-cell heterogeneity, and cell-state distributions?
-
Can the authors provide matched ablation studies to isolate the contribution of PBE, including the effects of patient-bulk conditioning and the auxiliary bulk reconstruction loss?
-
Since the conditional generator already incorporates patient-specific information, how do the authors determine whether BCS recovers missing expression signals or amplifies those already captured by the generator? Can the authors provide a more detailed analysis of patient-specific expression estimates before and after BCS correction, particularly at the single-cell level?
-
Since the primary DEG evaluation is performed at the patient and cell-type levels, could the authors include comparisons with established deconvolution methods that infer sample-specific, cell-type-specific gene expression from bulk RNA-seq, such as bMIND, BayesPrism, and CIBERSORTx, under the same data constraints?
-
DEG significance depends on both between-group expression differences and within-group variability across patients. How well do the generated cell-type-specific pseudobulk profiles reproduce the patient-level expression variance observed in matched measured single-cell data? Could the authors investigate whether the generated profiles underestimate within-group variance, potentially leading to inflated DEG significance?
-
Can the authors provide the complete source dataset manifests, clarify donor-level data separation, and release the implementation details or source code? Additionally, can the agentic benchmarking workflow be reproduced with complete execution records, including prompts, model/tool versions, search budgets, and human interventions?
2 comments
Response to Reviewer Vaau (Part 2 of 2)
W1/Q4 · How does patient-specific expression compare with deconvolution? · Tables 2–3, 9, 13
Answer. Across all three cohorts, our model recovered more DEGs and better matched expression within each patient. BayesPrism better ranked patients for each gene.
Stage 1 estimates cell-type proportions. Cells sampled separately from the same patient can differ in composition from the bulk specimen. Table 9 uses pseudobulk summed from each patient’s annotated cells, so the exact fractions are known.
On measured bulk from the same patients, our model detected more reference DEGs than BayesPrism in each cohort. In T-ALL, for example, it detected 6 of 11 versus 0 of 11 (Table 13).
In our run of the public CIBERSORTx High-Resolution web tool, it returned no gene expression estimates for breast cancer epithelial cells. In T-ALL, it estimated expression for 326 genes, but each gene had the same predicted value in all 37 patients. Only sepsis supported a comparison of patient differences. On the same 283 genes with varying CIBERSORTx estimates, CIBERSORTx tracked patient rankings less closely than BayesPrism (Spearman ρ of 0.51 vs. 0.60) and also reproduced disease-group differences less accurately (Pearson r of 0.43 vs. 0.62). We report this partial comparison here because Table 13 compares methods across all three cohorts. We did not have time to complete the bMIND comparison during the rebuttal period. For the camera-ready version, we will complete that comparison and rerun CIBERSORTx after checking its reference matrix, batch settings and processing code. We will report both analyses and their limitations in the supplement.
W1/Q5 · Does low within-group variance inflate DEG significance? · Tables 1, 4, 5, 14
Answer. Generators must capture group means and within-group patient variation. Ours had smaller absolute errors in between-patient variance than scSemiProfiler for 19/26 genes in triple-negative and 17/26 in ER-positive tumors. Case/control counts were 36/54 and 38/54 in sepsis, and 4/11 and 7/11 in T-ALL.
| Breast comparator (patients) | Effect magnitude and Welch SE both closer | Signed effect closer | DEGs: Ours vs comparator |
|---|---|---|---|
| Official CFGen (14) | 23/26 | 26/26 | 10 vs 0 |
| scSemiProfiler-direct (14) | 16/26 | 20/26 | 10 vs 0 |
| Bulk2Space (11) | 18/24 | 25/26 | 7 vs 1 |
Joint counts use absolute deviations from 1 in predicted/measured ratios (log scale: 15/26 vs scSemiProfiler). Two Bulk2Space genes had undefined tests.
SE was below measured for 24/25 hits. With effects fixed, we reran BH-adjusted Welch tests using our gene-wise group variances. scSemiProfiler went from 0/0/9 to 6/4/9 hits (breast/T-ALL/sepsis). For 4/6 new breast hits its triple-negative variance exceeded 5× measured (TRPS1: 0.450 vs 0.050 measured, Ours 0.025). For RASGRP1, one of 4 new T-ALL hits, its control variance was 0.658 vs 0.282 measured (Ours 0.165). Substitution lowered adjusted p from 0.557 to 0.0097. CFGen stayed at 0/0/0. Bulk2Space stayed at zero in T-ALL and sepsis (1 to 0 in 11 matched breast patients). At equal variances Ours led in breast and T-ALL and tied in sepsis (10/6/9). Signed effects favored Ours over CFGen for all 26 breast genes.
Table 14. Between-patient variance within each clinical group
Median gene-wise ratio of generated to measured between-patient variance within cases/controls (1 = measured).
| Method | Breast | T-ALL | Sepsis |
|---|---|---|---|
| Ours (PBE + BCS) | 0.511/0.235 | 0.317/0.531 | 0.364/0.213 |
| Official CFGen | 0.196/0.069 | 0.023/0.030 | 0.052/0.316 |
| Bulk2Space | NA (11/14 profiles) | 0.007/0.029 | 0.002/0.006 |
| scSemiProfiler-direct | 0.719/0.033 | 0.635/1.399 | 0.835/1.572 |
Weakness 2 / Q6 · Can others reproduce the splits, model and agent workflow? · Tables 10–12 · Supplement Tables 4–5
Answer. Yes, the literature search can be rerun under the documented settings. We ran each strategy three times per cohort with Sonnet 5.5 high. Under the same evidence criteria, our search found more measured DEGs than the adapted SCTA search in eight of nine comparisons (Tables 11–12). The reproducibility package includes the search instructions, execution records and scoring code.
Supplement Tables 5 and 4 list focus-type reference studies and BCS settings. Training/validation used 307/76, 28/9 and 91/25 specimens, and BCS refits used 307/27/89 source IDs (breast IDs are specimen-level). The recorded source and evaluation patient IDs were disjoint in all three cohorts. Appendix A specifies PBE widths and decoder Eq. 5. Inference used adaptive Dopri5 with 20 trajectory points. Both original literature workflows used Sonnet 5 high. Table 10 compares model versions and effort, Table 11 gives three runs per method and Table 12 gives unique hits and list overlap. Separate Sonnet 5.5 runs allowed 24 searches, 60 documents and 45 minutes without human intervention during scored runs. We will release code upon acceptance.
Response to Reviewer Vaau (Part 1 of 2)
Thank you for such a thoughtful review. We were struck by how precisely your questions identified what our emphasis on disease-related DEGs had left open. They prompted us to compare expression within individual patients as well. Our model detected the most measured cell-type DEGs among generators evaluated on the full cohort in each disease, and ranked first in T-ALL and second in sepsis for patient mean expression error (Table 1).
Weakness 1 / Q1 · How well do cells match measured distributions, heterogeneity and cell states? · Tables 1, 4
Answer. Our model better matched the measured cell distributions than scSemiProfiler in T-ALL and sepsis. The three external baselines were closer in breast.
We compared each gene’s expression distribution between generated and measured cells from the same patient using Wasserstein distance. Across 2,000 genes, our paired distance minus scSemiProfiler’s was +0.051 in breast (14/14 patients), −0.067 in T-ALL (26/37) and −0.028 in sepsis (53/53). Our cell-to-cell variance error was lower than that of all three baselines in sepsis and higher than that of all three in breast. After removing each gene’s mean, Ours also had a smaller distribution distance than scSemiProfiler in T-ALL and sepsis (Table 4). These comparisons measure heterogeneity one gene at a time. A frequency for a state defined by several genes requires their joint expression in the same cells.
Weakness 1 / Q2 · What do bulk conditioning and reconstruction each contribute? · Table 1 and a separate matched retraining experiment
Answer. Giving the generator each patient’s bulk RNA through PBE was enough to detect reference DEGs in all three cohorts, even without the auxiliary reconstruction loss. BCS then adjusted the size of group differences already present in the generated cells, bringing more genes above the detection threshold.
Table 1 shows the two configurations reported in the paper. On the same PBE output, applying BCS raised the count from 3 to 10 of 26 reference genes in breast cancer, from 5 to 6 of 11 in T-ALL, and from 5 to 9 of 54 in sepsis. The new control trained without PBE detected none in any cohort, with or without BCS.
In a separate experiment outside Table 1, we retrained under matched conditions to isolate the auxiliary loss. Before BCS, patient conditioning alone yielded 2, 3 and 4 DEGs (breast, T-ALL and sepsis). With BCS, those counts were 7, 3 and 5. Adding the auxiliary loss during training gave 6, 6 and 9 after the same correction. Thus the loss added detections in T-ALL and sepsis, while breast cancer had one fewer. Patient conditioning already supplied a detectable disease signal before either reconstruction or correction.
Weakness 1 / Q3 · Does BCS restore missing signals or amplify existing ones? · Tables 1, 4, 5, 6
Answer. In the PBE model, BCS amplified existing group differences enough for additional genes to pass the DEG criteria.
We kept the generated cells fixed and used each patient’s bulk measurement to adjust their expression within each cell type. All 12 newly detected cohort–gene pairs already had the measured direction before correction (Table 1), and mean squared error in the disease-group effects fell in every cohort (Table 4). In breast cancer, BCS raised the median absolute-effect ratio from 0.255 to 0.336 and the SE ratio from 0.501 to 0.560, while detections rose from 3 to 10 of 26 (Table 5). For individual cells, the average-centered distribution distance fell after BCS, while the distance on the original expression scale rose (Tables 1 and 4). Corrected profiles also more often matched their own patient than another patient in the same clinical group, although scSemiProfiler led on that measure (Table 6).