- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces STEP as a framework for spatiotemporal perturbation prediction using wildtype snapshots of spatial transcriptiomics. It combines a mask-aware autoencoder with unbalanced optimal transport and flow matching in order to learn wildtype temporal dynamics. The method performs interventions through a decoder-consistent proximal edit operator, ensuring counterfactual states remain biologically coherent. The manuscript validates STEP using both synthetic data, wildtype inter-/extrapolation, static spatial CRISPR, dynamic SPAC-seq, and a developmental case study on zebrafish.
Critical strengths
Setting. The paper is very well-motivated for a difficult and relevant problem.
Approach. The mechanism is conceptually appealing.
Breadth of benchmarking. Empirical benchmarking is diverse with wildtype dynamics, static perturbations, dynamic perturbations, and so on.
Critical weaknesses
The extrapolation results are difficult to interpret without simple sanity baselines. The paper argues that STEP maintains "positive rank alignment," but 0.010 Spearman is practically zero. I would not view this result as meaningful evidence of a successful extrapolation. The paper lacks simple sanity baselines such as: no-change, a linear gene-wise extrapolation, constant latent velocity, or an OT-only coupling (to disentangle the benefit of STEP's learned vector field). It is hard to see whether the better RMSE is explained by meaningful or more conservative predictions. Since the authors make strong claims about extrapolation, even when correlation is essentially zero, it is important to explore the predictions more.
The provided code raises substantial reproducibility concerns. The GitHub code has large inconsistencies with the paper, making reproducibility a major concern. It doesn't seem to contain any of the mask-aware neural encoders/decoders, unbalanced optimal transport, nor their flow-matching objective. It instead shows a very basic demo using PCA and nearest neighbors. Noticeably, it doesn't even include PyTorch or POT as dependencies -- thus not a single neural network -- despite the paper explicitly stating these packages.
Questions for authors
Clarification on basic assumptions. Disease-related populations may have GRNs and dynamics that differ substantially from wild-type populations. Does it make sense for knockouts to stay on the wild-type manifold?
Clarification about reproducibility. Is there any code for the experiments and results in the paper?
Baselines for the machine learning-based methods. Could you add some simple sanity baselines such that readers could better understand the strength of the methods? These could for example be relevant when interpreting results of Table 1.
Minor:
Line 161 seems to have an error with a sudden "(...), with full replicate integration and preprocessing protocols detailed in Appendix H" while discussing the destructive nature of spatial profiling.
Appendix D should be "Extended" rather than "Entended"
6 comments
Rebuttal Part 2/2
2. Is the actual neural implementation available (W2, Q2)?
Yes. We apologize for the incomplete code release: the previous repository contained only a demo. We have now updated the code repository linked in the manuscript with the full PyTorch implementation of STEP, including the mask-aware encoder/decoders, unbalanced optimal transport, flow-matching objective, and repeated projection operator. The repository provides the required dependencies, model configurations, and instructions for running STEP.
3. Why is a WT reference reasonable when disease dynamics differ (Q1)?
A WT reference provides a context-specific starting point, not a constraint that KO states must remain within the WT distribution. STEP assumes that WT-derived spatial context and local temporal organization provide useful information for short-horizon perturbation-response prediction, even when perturbations induce distributional shifts. This principle is also adopted by existing perturbation modeling methods, including CellOracle (Kamimoto et al., 2023, Nature) and Celcomen (Megas et al., 2025, ICLR), which use unperturbed reference data to model in silico perturbations.
In STEP, target-specific latent editing is mapped to expression space by the decoder. The decoder image (Eq. 29) defines representable expression states, whereas empirical WT support reflects the observed training-state distribution; these are not equivalent. We therefore assessed whether measured KO states and STEP-generated edits could extend beyond empirical WT support. The threshold was defined by the 95th percentile (q95) of WT leave-one-out latent kNN distances, using matched local tissue contexts.
Table R3.2. Percentage of states exceeding the empirical WT-reference threshold; means over three model initializations per assay.
| Assay | Matched WT above q95 (%) | Measured KO above q95 (%) | Generated edit above q95 (%) |
|---|---|---|---|
| HT29 | 1.19 | 5.95 | 0.00 |
| Mouse lung | 8.33 | 73.75 | 12.08 |
| SPAC-seq | 2.77 | 2.09 | 0.00 |
In mouse lung, 73.75% of measured KO states but only 8.33% of matched WT states exceed q95. Importantly, 12.08% of STEP-generated edits also exceed this threshold, demonstrating that STEP does not enforce hard membership in the empirical WT support. However, the smaller fraction relative to measured KO states indicates that STEP does not fully reproduce the observed distributional shift.
We further tested whether the predicted responses depend on the identity of the targeted gene. With the initial tissue context fixed, we compared correct-target edits against wrong-gene edits and 20 random directions matched to the final latent displacement norm. Candidate edited genes were excluded from response scoring.
Table R3.3. Gene-identity and final-displacement controls; AUPRC ↑, means over three model initializations.
| Assay | Correct edit AUPRC ↑ | Wrong-gene edit AUPRC ↑ | Final-norm random AUPRC ↑ |
|---|---|---|---|
| HT29 | 0.1410 | 0.1320 | 0.1258 |
| Mouse lung | 0.2693 | 0.1247 | 0.1536 |
| SPAC-seq | 0.1694 | 0.1626 | 0.1652 |
Correct-target editing achieves the highest AUPRC in all three assays, with the clearest separation in mouse lung (0.2693 vs. 0.1247 for wrong-gene edits and 0.1536 for random directions). The smaller differences in HT29 and SPAC-seq indicate that target-specific prioritization is assay-dependent.
Together, these results support WT-derived tissue context as a useful reference rather than a hard constraint on perturbation states. By repeatedly enforcing target-specific edits during temporal propagation, STEP allows perturbation responses to evolve beyond empirical WT support while retaining the intended intervention. Its current formulation provides a framework for target-specific response prioritization, although large disease-specific distributional shifts are not yet fully recovered. These analyses are in Appendix F (Tables 8–10); Section 6 discusses the WT reference and limitations.
4. Minor corrections. We have removed the misplaced Appendix-H phrase in Section 3.1 and corrected the heading to “Extended Data Figures” in Appendix D.
Thanks for providing fixed code. I did not check it, but I trust that it has the method now!
It was great to have some baselines to put the other numbers in perspective. However I believe that the authors will need to rethink the narrative after all of these new things provided to the individual reviewers.
When reading the pdf right now, the story gets very overwhelming, and it does not leave the sense of a clean ICLR-quality paper with highly trustworthy results.
I am thankful for the large and hasty efforts during the review process, and the idea is good, so it's likely that the paper will eventually reach publication -- but at the current stage I choose to retain weak reject
Rebuttal Part 1/2
We thank the reviewer for the valuable suggestions on baseline evaluation, extrapolation assessment, and code reproducibility. Our point-by-point responses are provided below.
1. What do simple sanity baselines reveal about STEP's extrapolation claim (W1, Q3)?
We added four sanity baselines—no-change persistence, gene-wise linear extrapolation, latent OT-only constant-velocity continuation, and expression-space OT-only continuation, to compare with stVCR and DeepRUOT.
On ARTISTA and MOSTA, expression-space OT-only leads all four gene-level interpolation metrics (Pearson, Spearman, RMSE, and DE AUPRC), likely benefiting from observed snapshots bracketing held-out stages. This advantage does not consistently extend to extrapolation, which uses only preceding snapshots. Temporal sampling also matters: no-change achieves the lowest RMSE and SWD on densely sampled MOSTA, illustrating that conservative persistence can favor endpoint and distributional metrics without providing a directional forecast. ARTISTA's adult forecasting task comprises only one juvenile-to-adult transition across five non-uniform stages. Although expression-space OT performs strongly on this transition, STEP's Spearman is effectively zero and does not support meaningful rank alignment. These results underscore the need to distinguish endpoint accuracy, response-gene prioritization, and directional recovery.
To assess generalizability beyond developmental atlases, we evaluated axolotl limb regeneration profiled by Xenium (García-García et al., 2025, bioRxiv) and zebrafish heart regeneration profiled by Stereo-seq (Li et al., 2025, Nat. Commun.), spanning distinct dynamic processes and platforms. Across four datasets, two tasks, and five metrics (40 comparisons), STEP ranks first in 12 and among the top two in 26, the broadest top coverage among seven methods. On both regeneration datasets, STEP leads forecasting Pearson, Spearman, and RMSE, while achieving the highest DE AUPRC on zebrafish heart. Together, these results highlight STEP's directional forecasting strengths beyond developmental atlases, while simpler methods remain competitive on selected metrics. Table R3.1 reports forecasting; revised Table 1 covers both tasks (dataset and baseline details: Appendices H and J).
Table R3.1. One-step forecasting; bold: best, underline: second.
Importantly, STEP is not merely a WT forecaster; it unifies multi-snapshot spatial dynamics learning with target-specific perturbation prediction. It learns a continuous WT path law from unperturbed snapshots via mask-aware representation learning, relation-aware unbalanced OT, and neural flow matching. Decoder-consistent latent projection introduces localized gene interventions that are maintained during propagation through the learned WT field, generating spatially resolved, time-dependent counterfactual responses from WT-only training data.