- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
A notable strength of this paper is that it introduces a reasoning-like mechanism for single-cell perturbation prediction, where information retrieved from the training data is used to assist model updates during inference. I find this formulation interesting and potentially useful. However, I have some concerns regarding the model design. In addition, the general idea of querying or retrieving information from the training data has been explored in prior work. The current manuscript may therefore benefit from a more comprehensive discussion of the relevant literature, together with appropriate comparisons and citations to clarify the methodological distinction and novelty of the proposed approach.
Critical strengths
This paper proposes a reasoning-like mechanism for single-cell perturbation prediction, in which information retrieved from the training data is explicitly used to guide model updates during inference. I find this design particularly interesting, as explicit reasoning mechanisms of this kind remain relatively underexplored in the current single-cell perturbation prediction literature. This direction could be valuable for improving the flexibility and interpretability of perturbation prediction models.
Critical weaknesses
Although the implementation of the proposed reasoning-like mechanism is interesting, the related-work discussion appears incomplete and lacks important citations. Prior single-cell perturbation work [1] also leverages information from observed training data to guide perturbation-specific prediction or generation. While HEFR introduces a different mechanism based on iterative, hypothesis-dependent evidence retrieval and adaptive refinement, the conceptual connection to prior training-data-guided inference should be made explicit. The authors should therefore discuss [1] and clarify the methodological distinction between the two approaches, particularly which aspects of HEFR are genuinely new beyond this existing line of work.
[1] Doloris: Dual Conditional Diffusion Implicit Bridges with Sparsity Masking Strategy for Unpaired Single-Cell Perturbation Estimation
Questions for authors
-
[1] also leverages information from observed training data to guide perturbation-specific prediction or generation. While HEFR introduces iterative, hypothesis-dependent evidence retrieval and adaptive refinement, the conceptual relationship to this prior line of work is currently unclear. Could the authors discuss and clarify the methodological distinction between the two approaches?
-
Why is cosine improvement used as the sole objective for the value-guided critic? The critic accepts or rejects a revision based on the predicted improvement in cosine similarity between the decoded aggregate response and the ground truth. While cosine similarity captures response direction, it is insensitive to response magnitude, which is also evaluated through RMSE and directly affects the target mean used by the REALIZE stage. Could the authors justify this design choice and evaluate alternative critic objectives, such as RMSE improvement or a combination of directional and magnitude-based criteria?
-
Since , any gene with appears to have strictly positive expression in every predicted cell after projection. How can the model represent the large number of exact zeros typically present in single-cell data?
-
Eq.~(13) defines REALIZE without an explicit stochastic latent variable or noise input. Could the authors clarify whether REALIZE is deterministic conditional on the input control cell, and, if so, how perturbation-induced variability beyond the heterogeneity already present in the control population is represented?
Overall, I would be open to increasing my score if the rebuttal can satisfactorily address the concerns above and clarify the key methodological choices and novelty positioning.
[1] Doloris: Dual Conditional Diffusion Implicit Bridges with Sparsity Masking Strategy for Unpaired Single-Cell Perturbation Estimation
5 comments
Part 2/3 of the responses
Q3: Exact-zero representation under the smoothed mean projection.
Response: Thank you for your insightful comment. For genes with a positive target mean, the projection does not explicitly represent exact zeros. Eq. (15) is designed to enforce the predicted cell population to match the reasoning-predicted response means through a smooth, differentiable (important for our distributional optimization) normalization. Adding to both the preliminary expression values and their mean keeps the normalization well-defined while preserving the target mean exactly. Importantly, the projection preserves key aspects of continuous cell-to-cell heterogeneity, and exact zeros can be introduced through mean-preserving post-processing.
What the projection preserves: Let and be the preliminary expression mean and standard deviation of gene . For , Eq. (15) gives , where . Since , we have . Thus, projection preserves key properties such as standardized expression patterns, within-gene cell rankings, and Pearson correlations between nonconstant positive-mean genes. These properties establish preservation of relative expression organization. Moreover, REALIZE’s distributional losses act directly on the projected populations, so training optimizes population fidelity under the mean constraint.
Adding exact zeros by mean-preserving post-processing: We threshold low expression values as , compute , and rescale the retained values as . Thresholds are determined exclusively from training/calibration data. If all entries are removed for a positive-mean gene, its largest entry is retained before rescaling. Zero-mean genes remain entirely zero. This post-processing preserves gene-wise means exactly and requires no retraining.
We further evaluate distributional performance before and after post-processing across the settings in Tables 1–3. All relative changes are below 0.5%, preserving the reported advantages, as shown below. When , preliminary zeros are mapped to a small positive floor, , helping explain why removing these low-level values and rescaling to restore the means has little effect on distributional performance.
Distributional metrics changes with mean-preserving post-processing:
| Setting | MMD-G: before → after ↓ | MMD-P: before → after ↓ | DEG-R: before → after ↑ |
|---|---|---|---|
| Unseen perturbations — drug | 0.1046 → 0.1051 | 0.1095 → 0.1091 | 0.1019 → 0.1023 |
| Unseen perturbations — gene | 0.3347 → 0.3338 | 0.3981 → 0.3993 | 0.1402 → 0.1397 |
| Unseen combinations — drug | 1.1095 → 1.1128 | 2.2406 → 2.2339 | 0.1128 → 0.1132 |
| Unseen combinations — gene | 0.3712 → 0.3705 | 0.2438 → 0.2446 | 0.2941 → 0.2934 |
| Unseen cellular contexts | 0.4216 → 0.4229 | 0.5008 → 0.4994 | 0.1861 → 0.1866 |
We also compare zero-frequency agreement against observed treated populations on the sciPlex3 unseen-perturbation benchmark, results are shown below. The output achieves competitive agreement in both per-gene zero frequencies and per-cell detection fractions. Thus, the post-processing addresses exact-zero representation while retaining the predicted means and distributional performance. We have clarified the original smooth output’s scope and documented the post-processing in Appendix D.6 of the revised paper.
Zero-frequency agreement:
| Method | Gene-wise zero-fraction MAE ↓ | Detected-gene-fraction Wasserstein distance ↓ |
|---|---|---|
| CellFlow | 0.056 | 0.075 |
| State | 0.044 | 0.030 |
| HEFR + sparsification | 0.041 | 0.032 |
Part 3/3 of the responses
Q4: Determinism of REALIZE and its representation of perturbation-induced variability.
Response: REALIZE is deterministic given the input control cell, perturbation descriptor, and terminal hypothesis. However, the deterministic transformation in REALIZE can change population variability rather than simply preserve the variability of the controls. For our population-distribution prediction task, control cells provide diverse initial states, and REALIZE learns how each state responds to the perturbation. Because this transformation is nonlinear and cell-state-dependent, different cells can undergo changes of different magnitudes and directions. It can therefore amplify, suppress, or reshape variability, altering population variance, gene correlations, and state composition without an explicit noise input.
These distributional changes are supervised directly using treated populations. The objective includes gene- and PCA-space distributional discrepancies and a PCA-space variance-matching term, all evaluated after mean projection (Appendix A.3 of the initial manuscript). The mean-matched control supports this design: rescaling control cells to the same terminal predicted means yields MMD-G 0.2903, compared with 0.1046 for REALIZE (Table 4 of the initial manuscript), demonstrating improved population fidelity beyond mean adjustment alone. This represents perturbation-induced changes in the population distribution through a learned transformation of control-cell states.
We hope our responses have addressed your concerns, and we welcome further discussion if any clarification is needed, thank you!
Part 1/3 of the responses
We sincerely thank you for your time and thoughtful comments, which have helped us clarify and strengthen the manuscript. We respond point by point below.
Response: We have added Doloris [1] to Related Work and clarified their distinctions (Line 111 in the revised paper). Both methods utilize observed training information, but differ fundamentally at both conceptual and mechanistic levels.
Overall, Doloris centers on modeling unpaired control and perturbed-cell distributions through dual conditional diffusion bridges, with sparsity masking to preserve expression diversity, whereas HEFR centers on hypothesis-evidence feedback reasoning to refine aggregate perturbation-response hypotheses and adapt reasoning depth.
[1] Doloris: Dual Conditional Diffusion Implicit Bridges with Sparsity Masking Strategy for Unpaired Single-Cell Perturbation Estimation.
Response: We chose cosine gain to prioritize response-direction refinement among candidates produced by magnitude-supervised prediction modules. The regression objective for f0 and latent residual losses for Gθ/Hν provide magnitude-sensitive supervision. Cosine is therefore the critic’s selection criterion, rather than the model’s sole training signal.
Following your suggestion, we directly compare cosine gain, RMSE gain, and their normalized combination on sciPlex3. RMSE gains are computed from the target mean-expression profiles passed to REALIZE. From the table below we can see that Cosine gain yields the highest Cos-FC. The RMSE gain slightly improves mean-expression accuracy but lowers directional accuracy. The combined objective also yields a lower Cos-FC, with small improvements in RMSE and MMD-G. These results support our direction-focused critic design: it provides the strongest directional prediction in this comparison, with only small differences in mean-expression error and population discrepancy. We have included the results in Appendix D.5 in the revised paper (Table 16).