- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors introduce a novel chromatin-informed approach for perturbation modeling, leveraging chromatin accessibility and DNA sequence features alongside gene-level embeddings to inform post-perturbation gene expression prediction. Their approach, named ChromaPert, is designed to handle predictions for unseen perturbations as well as unseen cell states by using representations of perturbations and cell states to query a source bank of training set expression offsets and aggregating a weighted set of retrieved offsets as predictions. The authors leverage paired multimodal (RNA + ATAC) single-cell data and benchmark ChromaPert against 14 foundation model baselines, reporting performance across three separate categories of metrics: mean-response shape, pointwise accuracy, and transport/direction. The authors show that ChromaPert yields strong performance across these metrics on the unseen perturbation and unseen cell state prediction tasks. While the paper presents a novel framework for incorporating chromatin-level regulatory information into the perturbation prediction task, the presentation of the results makes the impact and merits of the work difficult to assess.
Critical strengths
- The paper proposes a framework that uniquely attempts to leverage chromatin accessibility and DNA sequence information for improved perturbation prediction. The use of such data is currently underexplored and has the potential to provide valuable insights about the utility of other data modalities for perturbation prediction tasks and virtual cell modeling.
Critical weaknesses
- The paper’s presentation quality is poor, with many sections that are difficult to follow, making it not easy to assess the merits and contributions of the work. Factors that contribute to this poor presentation quality include the following: the inclusion of abundant non-standard technical terminology (e.g., “source addback”, “training-fold standardization”, “statebase”, “clean-flow”, “response-slope Pearson”), inconsistent terminology (e.g., “Top-20-gene Spearman” vs. “Pearson_{Delta, DE}” vs. “DE-focused correlation” for the same metric), unexplained benchmarks (e.g., GSE).
- The paper includes limited discussion and interpretation of results, with the Results section primarily focused on reiterating quantitative results that can be found in the papers’ tables.
- According to the Results section text, the unperturbed control is excluded from the rankings, but this baseline seems to yield the best or second-best performance on a number of the metrics included in Table 1 (e.g., all Pointwise Accuracy metrics). It’d be helpful to include a discussion of this result to contextualize ChromaPert’s overall performance.
- The paper contains a number of formatting errors. For example, the order of cited sections of the paper do not cohere with the sections’ numbering (e.g., Appendix B.4 comes before Appendix B.1-B.2 in the main text).
- The ablation results (Section 4.5) appears to only show a subset of the metrics that were used in the previous tables (e.g., L2, W1, discriminative cosine). The inclusion of the complete suite of metrics would more comprehensively demonstrate the conclusions drawn from the ablation analyses.
Questions for authors
- What do the points in Figure 3 represent? The caption mentions that the box “summarizes completed folds for the corresponding setting”, but it is presently unclear what this statement implies. The inclusion of multiple points per method in these boxplots would seem to indicate that standard deviations can be included in the Results tables as well.
- How are the DNA sequences featurized? Which GENCODE/RefTSS annotations, ENCODE cCRE annotations, and local descriptors are used?
- Based on the text’s description, the control context variable () appears to include twice (Equations 2 and 3). appears to already contain , but is also included in the definitions for and . Can you please clarify this definition?
- What is meant by GSE in the following sentences? “GSE also evaluates 19 known targets across seven held-out states” (Section 4.1), “On GSE held-out-target evaluation” (Section 4.4)
9 comments
W2: Analysis of experimental results.
R: Thank you for suggesting more interpretation of the results. Accordingly, we have clarified what the experiments show about target generalization, state transfer and component contributions in the corresponding paragraphs.
| Experimental section | Question addressed and conclusion |
|---|---|
| Sec. 4.2: Unseen targets in K562 | Tests target generalization in a fixed cellular background, and Hallmark analysis supports recovery of shared proliferation and cell-cycle programs. |
| Sec. 4.3: Unseen targets in GSE | Tests prediction of unseen-target responses in a background containing multiple cell states. |
| Sec. 4.4: GSE state transfer | Response geometry and retrieval analyses support preservation of state-dependent differences in the response to the same perturbation. |
| Sec. 4.6 and Appendix A.1: Component controls | Source decomposition corrects control-baseline differences. The main advantage of flow over Direct MLP is response correlation, while absolute errors do not improve uniformly. |
| Sec. 4.6 and Appendix A.4: Prior ablations | Molecular and regulatory priors contribute complementary information. ESM-2 contributes strongly to target-response correlations, while the effects of cCRE and Multi-TSS differ across metrics. |
| Sec. 4.6 and Appendix A.1: Aggregation controls | Training-control proportions retain most response-correlation performance, whereas uniform aggregation reduces it, showing that composition weights affect population-response aggregation. |
To help readers understand the model design through the experiments, we have added these explanations to revised Secs. 4.2–4.6, directly connecting the design objectives, experimental observations and conclusions (Tables 1–6).
W3: Performance of Control baseline.
R: Control is the unperturbed reference baseline. As already noted in Sec. 4.3 of the original manuscript (lines 377–378), its low MSE and near-zero response correlation show that absolute error alone does not capture response structure. When most genes change weakly, predictions close to control can achieve low global error, consistent with the signal-dilution issue discussed in previous work [1,2]. Therefore, the task requires evaluation of both pointwise errors and perturbation-induced response patterns. To make this trade-off clearer, we retain the comparisons in which Control has lower errors in some settings and have added the explanation to revised Secs. 4.1 and 4.3.
W4: Order of appendix references.
R: Appendices and the main text have different organizational structures. Specifically, our appendices are organized into supplementary experiments (A), data and evaluation protocols (B), and methods and implementation (C). The original Sec. 4.1 follows the order in which concepts arise, citing B.4 to explain composition weights before B.1–B.2 for datasets and splits.
We apologize that this arrangement made navigation difficult. To improve navigation, we have reordered revised Sec. 4.1 to introduce datasets and splits before composition aggregation, so the references now appear as B.1–B.2 followed by B.4 (revised lines 309–310).
W5: Complete metric reporting for ablations.
R: We kindly clarify that we already reported all seven metrics, including L2, W1 and discriminative cosine, in Tables 7 and 8 of the submitted appendix. Sec. 4.5 directly cites Table 7 and points to Appendix A.5, which contains Table 8, through “Further controls appear in Appendices A.1, A.5, and A.6.” (lines 454–462). To address your concern, we have clarified this point in Section 4.6 of the revised manuscript.
Q1: The meaning of Figure 3 points and the report of fold-level SDs.
R: We kindly clarify that each Figure 3 point represents a held-out evaluation condition: a target for Target-LOO or a state–target pair for Cross. K562 and GSE Target use 18 and 19 held-out-target folds, respectively, whereas GSE Cross uses seven held-out-state folds, each evaluating 19 known targets, giving 133 condition points, with each box summarizing all condition results for its setting.
Because the paired RNA–ATAC benchmarks have few targets, we use leave-one-out evaluation to cover all available targets and evaluation states. Thank you for suggesting that we report fold-level standard deviations. We provide the PearsonΔ mean ± SD below:
Table 2: PearsonΔ mean ± SD across leave-one-out folds. For Cross, the 19 targets are first averaged within each state fold, after which SD is computed across the seven state folds.
| Method | K562 (18 folds) | GSE Target (19 folds) | GSE Cross (7 state folds) |
|---|---|---|---|
| GEARS | 0.0878±0.0785 | 0.0263±0.1529 | 0.1013±0.0661 |
| scGPT | 0.0676±0.1114 | 0.0416±0.1260 | 0.0978±0.0610 |
| CellFM | 0.0634±0.0845 | 0.0716±0.0820 | 0.0696±0.0587 |
| scDFM | 0.0100±0.1435 | -0.0374±0.1023 | 0.0812±0.0648 |
| CellFlow | 0.1437±0.1540 | 0.0698±0.1927 | 0.1484±0.1159 |
| ChromaPert | 0.2210±0.1242 | 0.1735±0.1606 | 0.1829±0.0767 |
Compared with CellFlow, ChromaPert has higher means and smaller fold-level SDs in all three settings. To make this clearer to you, we have explained the points and boxes more clearly in the Figure 3 caption and added the standard-deviation summaries to Appendix A.13, Table 22.
Q2: DNA encoding and annotation sources.
R: DNA is encoded using sequence-composition and short-sequence-count features from TSS windows, with GENCODE and RefTSS locating the TSSs and ENCODE cCREs providing locus-level regulatory context. Short-sequence counts are a common feature type in regulatory sequence modeling [3].
Specifically, for each gene, we average descriptors from up to three strand-oriented 2,000-bp TSS sequences: four nucleotide fractions, normalized counts of CG, GC, AT, TA, CA, TG, GATA, CACGTG, CCGGA and TATA, and GC fractions in four subwindows. The local locus interface separates sequence and accessibility components, while the regulatory bank combines GRCh38 TSS annotations, ENCODE SCREEN cCRE overlaps, guide descriptors and lightweight JASPAR proxies. Deterministic coordinate selection maps its 265 or 272 raw fields to a 128-dimensional interface. We have clarified the feature sources and concatenation in revised Sec. 3.1 and added the encoding steps to Appendix C.1.
Q3: Repeated concatenation of locus features.
R: Yes, repeated concatenation gives locus features a greater share of the conditioning vector, so it can be understood as a parameterization choice using the same underlying information. Equations 2–3 and the 576-dimensional and 736-dimensional conditions in Appendix C.1 match the implementation:
xₚ = [uₚ ∥ ℓₚ], cₚᵖᵒᵒˡ = [xₚ ∥ ℓₚ], cₚ,ₛˢᵗᵃᵗᵉ = [xₚ ∥ ℓₚ ∥ hₛ].
Because the molecular block uₚ appears once and the locus block ℓₚ twice, their relative representation in the condition input changes. The retrained single-copy comparison is shown below:
Table 3: Removing the duplicate locus copy from the flow condition on GSE Target.
| Condition input | |||
|---|---|---|---|
| Original Full: [xₚ ∥ ℓₚ] | 0.1735 | 0.3697 | 0.001054 |
| Single locus copy: xₚ | 0.1598 | 0.3558 | 0.00108 |
Because these results support this parameterization in the reported setting, we have clarified the repeated concatenation in revised Sec. 3.1 and added the ablation to Appendix A.11, Table 20 (the rationale appears at revised line 194).
Q4: Abbreviation for the GSE dataset.
R: GSE is our abbreviation for GSE274113 Perturb-Multiome. To address your concerns, We have explicitly defined it at the dataset’s first introduction in revised Sec. 4.1 (revised line 304).
We hope these clarifications and additions address your questions and provide a basis for you to reconsider your rating. Thank you again for your careful reading. If anything remains unclear, we would be happy to explain it further.
References
[1] Ahlmann-Eltze et al., Nat Methods, 2025.
[2] Miller et al., Nat Biotechnol, 2026.
[3] Ghandi et al., PLoS Comput Biol, 2014.
We sincerely thank you for recognizing the value of incorporating chromatin accessibility and DNA sequence information into perturbation prediction. Below, we address each point and describe the corresponding revisions.
W1.1: Technical terminology.
R: To make these operations easier to understand, we have replaced their names with descriptions of the computational steps and explained their meanings at first use. The corresponding changes are as follows:
To help readers understand these operations defined in Secs. 3.1–3.3, we have unified the wording in the revised Methods, Results and figure captions, and retained the definitions of the corresponding computations in Appendix C.2.
W1.2: Difference between Top-20 response-slope Spearman and PearsonΔ,DE
R: Top-20 response-slope Spearman and PearsonΔ,DE evaluate different quantities and are not different names for the same metric. Revised Sec. 4.1 defines the primary evaluation metric, while Appendix A.2 provides the calculations for both slope diagnostics and the results under true and shuffled pairing:
To avoid confusion, we have explicitly distinguished these metrics in revised Sec. 4.1 and the Figure 2 caption and added the definitions, calculations and numerical results for both slope metrics in Appendix A.2.
W1.3: Abbreviation for the GSE dataset.
R: GSE refers to GSE274113, the Perturb-Multiome dataset. Following your suggestion, we have explicitly defined GSE as its abbreviation when first introducing the dataset in revised Sec. 4.1 and used it consistently thereafter (revised line 304).