- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes KoopCell, a generative model that combines a VAE with Koopman-inspired linear latent dynamics learned from unpaired single-cell snapshots using a weak-form estimator. Its extension, KoopCell-M, adds hidden memory variables and mixture initialization to model branching, guided by biological annotations and developmental paths. Synthetic experiments examine spectral recovery and branching, while evaluations on three scRNA-seq datasets report improved average extrapolation performance over the tested baselines.
Critical strengths
The weak-form formulation connects population-level observations to latent generator estimation, providing a closed-form update and theoretical characterizations under explicit assumptions. This is a useful contribution to a challenging single-cell modeling problem.
Synthetic experiments examine spectral recovery and branching, while three scRNA-seq datasets test interpolation and extrapolation. The reported improvements in average extrapolation performance support the framework's practical promise for predicting unobserved cell populations.
Critical weaknesses
1. Insufficient ablation of the memory mechanism.
In Appendix D, KoopCell-M introduces additional hidden dimensions, mixture components, and learned conditional initialization. Table 3 therefore cannot isolate the contribution of memory feedback from increased model capacity or hidden heterogeneity. A controlled ablation with the same architecture, initialization, and training protocol is needed to assess the role of the memory kernel. In addition, the experiments lack a comparison with Delay Flow Matching (Zhao et al., 2026), which the paper cites when motivating memory-based branching.
2. Additional biological supervision in KoopCell-M.
KoopCell-M uses annotated cell states, a predefined developmental DAG, supervised classification, and a path consistency loss, providing additional biological information unavailable to several baselines. It is therefore unclear whether the improvements arise from memory dynamics or this supervision. Ablations removing the developmental-path supervision and associated losses would help isolate their contributions.
3. Unclear methodological contribution of the weak-form estimator.
Existing methods such as WCR (Lu et al., 2024) already use weak formulations and regression to estimate dynamics from unpaired distribution snapshots. The authors should clarify the specific novelty of their estimator. Moreover, the experiments do not isolate its practical contribution from representation learning and population matching. A comparison with direct gradient-based optimization of the same latent linear dynamics would strengthen the evidence, particularly since Appendix D does not use the proposed closed-form updates.
4. Insufficient documentation of model selection.
Appendix E.2 describes baseline tuning, whereas Appendix E.3 only reports the final task-specific configurations of KoopCell and KoopCell-M. Please provide the validation splits, hyperparameter search spaces, selection metrics, tuning budgets, and checkpoint-selection rules. Explicitly confirm that held-out test time points were excluded from all model-selection decisions.
5. Missing simple temporal baselines.
The evaluation lacks simple baselines that would establish the benefit of learning continuous dynamics. For extrapolation, the last observed training-time distribution could be used to predict all future time points. For interpolation, OT-based displacement interpolation between neighboring observed snapshots should be included. If mean-expression accuracy is evaluated, linear interpolation of mean expression would also be useful. All baselines should use the same metrics and sampling protocol.
Questions for authors
1. What does the proposed weak-form estimator add to existing methods such as WCR (Lu et al., 2024)? Which components are inherited and which are new? How does KoopCell differ from the concurrent DisKO framework in its formulation, estimation procedure, and theoretical guarantees?
2. Neither KoopCell nor KoopCell-M explicitly models proliferation or death. How does this affect the interpretation of inferred trajectories and fate probabilities? Changes in lineage proportions may reflect differential proliferation or survival rather than differentiation. Please distinguish accurate population-distribution prediction from recovery of cell-fate dynamics.
3. Matching population distributions does not necessarily imply recovering correct cell-level transitions. Given the identifiability limitations acknowledged in Appendix A.4.2, what evidence supports the inferred developmental trajectories and fate probabilities? Could the authors validate these predictions using independent lineage-tracing information?
4. The paper emphasizes long-horizon extrapolation, but the real-data experiments cover relatively short extrapolation horizons. How stable are the learned dynamics over longer horizons, and how do the learned Koopman spectra relate to extrapolation errors across different seeds and temporal sampling densities?
9 comments
Reply to Reviewer KWRr (2/7)
1. Memory feedback and Delay Flow Matching (Weakness 1), continued.
Comparison with Delay Flow Matching (DFM). We additionally evaluate DFM on all three datasets and tasks. As in PI-SDE, we fix the representation to a 50-dimensional PCA space. We explore delays ; constant [DFM(C)] and diverse linear [DFM(D)] initial histories; hidden widths and depths ; SELU/Tanh activations; inclusion or omission of time inputs; and natural/clamped cubic-spline boundary conditions. Configurations are selected using training-only validation, and Table 3 reports the selected DFM(D) results as mean ± SD over three independent runs. [5]
| Data | Task | Prediction | DFM(D) | VGFM | KoopCell | KoopCell-M |
|---|---|---|---|---|---|---|
| ZB | Easy | Interp. | ||||
| Medium | Extrap. | |||||
| Hard | Interp. | |||||
| Extrap. | ||||||
| DR | Easy | Interp. | ||||
| Medium | Extrap. | |||||
| Hard | Interp. | |||||
| Extrap. | ||||||
| SC | Easy | Interp. | ||||
| Medium | Extrap. | |||||
| Hard | Interp. | |||||
| Extrap. |
Table 3. OT prediction error (mean ± sample SD; lower is better).
Like VGFM, DFM uses constructed conditional interpolation paths to supervise velocity learning. These flow-matching based algorithms not necessarily reflect the underlying biological dynamics. Our formulation instead learns a latent linear evolution directly from distribution snapshots. Consistent with this motivation, both KoopCell variants achieve lower mean errors than these flow-matching based methods, with particularly pronounced advantages in extrapolation.
Revised manuscript: Section 5; Appendices E.2 and E.4 (Tables 12–14).
2. Weak-form estimation and related methods (Weakness 3; Question 1).
Comparison with related works. We apologize for not making these connections and distinctions sufficiently clear in the original manuscript. We will make them explicit in the revised manuscript.
-
WCR [1]. Both methods use test functions to express the Fokker–Planck equation in weak form, enabling efficient regression of parameters that enter the equation linearly. WCR estimates drift and diffusion coefficients in a prescribed state-space dictionary through sparse regression, following the SINDy paradigm. [2]
In contrast, motivated by Koopman theory, we aim to learn coordinates that globally linearize the nonlinear dynamics. We jointly learn these observables and their linear generator. This formulation naturally integrates VAE representation learning with weak-form dynamics estimation and directly motivates our alternating algorithm: refine the VAE representation with the generator fixed, then estimate the generator in the updated coordinates. Our contribution lies in this Koopman formulation and dynamics-informed representation learning procedure, supported by theoretical guarantees for population-level estimator consistency and distribution prediction. Estimating dynamics in learned latent coordinates also supports scalability to 2,000-gene inputs; WCR only scales up to 20 dimensions. We have already covered these discussions in the revised related work section 5. [1]
Reply to Reviewer KWRr (3/7)
2. Weak-form estimation and related methods (Weakness 3; Question 1), continued.
-
DisKO [3]. Both methods model population dynamics from unpaired snapshots. In KoopCell, the observables act on individual gene-expression states . DisKO instead treats an entire distribution as the state, and learns distribution functionals (e.g., means and variances). The cell-wise VAE in KoopCell retains a distribution of individually encoded cells and yields a model of individual-cell dynamics. DisKO propagates one representation per population and does not specify individual-cell transitions. [3]
At the estimation level, DisKO fits evolution between snapshot embeddings (obtained from a set encoder) through gradient-based learning or discrete regression; KoopCell estimates a continuous-time generator from weak equations over encoded cell populations. While convergence and stability of the learning procedure remain open questions in DisKO [3], our theory establishes consistency of the population weak-form estimator, convergence of feature propagators, and Wasserstein prediction bounds under suitable conditions (Appendix A).
Comparison between weak estimation and gradient updates. We replace weak-form estimation with joint gradient-based optimization of the same latent dynamics and representation on the hard task for all three datasets, keeping the architecture and remaining loss terms unchanged.
| Data | Prediction | KoopCell: joint | KoopCell: weak | KoopCell-M: joint | KoopCell-M: weak |
|---|---|---|---|---|---|
| ZB | Interp. | ||||
| Extrap. | |||||
| DR | Interp. | ||||
| Extrap. | |||||
| SC | Interp. | ||||
| Extrap. |
Table 4. Hard-task OT error (lower is better), reported as mean ± SD.
KoopCell-M retains lower mean extrapolation error than KoopCell under joint training on all three datasets, suggesting that this advantage does not depend on the specific optimization method. Relative to these joint controls, weak-form estimation gives better empirical performance in most settings, with lower mean errors in 10 of 12 comparisons. Conceptually, it provides EDMD-style regression for learning the Koopman operator from unpaired distribution snapshots. [4]
We further use two spectral-recovery benchmarks to distinguish the roles of the weak loss and our alternating closed-form updates. With known observables, a single closed-form solve accurately recovers the spectrum; gradient updates require repeated epochs to reach comparable accuracy (Figure 12 in the revised manuscript). With unknown observables, we learn the representation and linear generator simultaneously, comparing alternating estimation against joint gradient updates with and without the weak loss (Figure 13 in the revised manuscript). Alternating estimation recovers the reference spectra faster and gives lower mean extrapolation errors at a matched epoch budget (500 epochs). Joint updates with the weak loss approach the reference spectral structure more slowly, whereas removing it fails to recover the Duffing oscillatory pair even after 2,000 epochs. These results show that alternating closed-form updates accelerate spectral recovery, while weak constraints support reliable recovery across both benchmarks.
Revised manuscript: Section 5 (WCR discussion); Appendices C.4 (Figures 12–13) and F.2 (Table 20).
Reply to Reviewer KWRr (1/7)
We thank the reviewer for the careful review and constructive suggestions. We have uploaded a revised manuscript containing additional results and figures, together with further discussion and clarifications. We kindly refer the reviewer to these revisions, especially the visualizations cited in the responses below. We address the weaknesses and questions below.
1. Memory feedback and Delay Flow Matching (Weakness 1).
Ablation for the memory mechanism (C=0). We apologize that the original toy model did not sufficiently separate the contribution of memory feedback from that of initial hidden heterogeneity. To address this concern, we first performed a C=0 ablation on the hard task of all three real datasets, keeping the architecture, other losses, and training protocol unchanged.
Table 1. ΔOT=OTC=0−OTfull (mean ± sample SD over three seeds); positive values indicate degradation. Extrapolation degrades consistently across datasets.
Beyond these empirical ablations on real datasets, Example B.1 (Appendix B.2.1; Figure 5 in the revised manuscript) provides a concrete case in which initial hidden heterogeneity produces transient branching even with C=0. We should clarify that hidden heterogeneity can initiate population branching, while memory feedback can sustain the resulting branches. We will make this mechanism explicit in the revision.
Mathematically, consider the augmented linear model:
\dot H_t=CZ_t+DH_t+b_h.$$ If $A,D$ are strictly dissipative (a common assumption in Mori-Zwanzig formalism), with a common margin $\gamma>0$, the $C=0$ model satisfies $$\\|\Delta Z_t\\|\le e^{-\gamma t}\bigl(\\|\Delta Z_0\\|+t\\|B\\|\cdot\\|\Delta H_0\\|\bigr)\longrightarrow0,$$ where $\Delta$ denotes differences within a population. Thus, feedback can sustain nondecaying coupled modes despite stable $A,D$, while $C=0$ leaves only decaying effects of initial heterogeneity and cannot maintain nonvanishing branch separation under a shared Lipschitz decoder. The original toy model is not suited to studying the system's long-time behavior. We therefore designed a new 64D toy model with persistent terminal branches and strictly stable parameterizations of $A,D$; its construction is detailed in revised Appendix D.1. Apart from fixing $C=0$, the two memory variants use identical architecture, initialization, losses, and training protocol. | Model | Interp. SWD ↓ | Interp. branch $W_1$ ↓ | Extrap. SWD ↓ | Extrap. branch $W_1$ ↓ | |:---|---:|---:|---:|---:| | KoopCell | $0.1393 \pm 0.0025$ | $0.2612 \pm 0.0082$ | $0.4712 \pm 0.0001$ | $1.1357 \pm 0.0001$ | | KoopCell-M | $\mathbf{0.0654 \pm 0.0006}$ | $\mathbf{0.0550 \pm 0.0007}$ | $\mathbf{0.0723 \pm 0.0043}$ | $\mathbf{0.0832 \pm 0.0091}$ | | KoopCell-M ($C=0$) | $0.1285 \pm 0.0032$ | $0.1901 \pm 0.0100$ | $0.4712 \pm 0.0001$ | $1.1355 \pm 0.0001$ | *Table 2. The SWD and branch-coordinate $W_1$ metrics from manuscript Table 3, separated into interpolation and extrapolation (mean ± sample SD over three training seeds). Training ends at $t=64$; extrapolation uses $t=80,96,128,160$.* KoopCell-M preserves separated branches throughout the test horizon, while KoopCell and the $C=0$ control merge (Figure 15 in the revised manuscript). This ablation further separates feedback's contribution to sustained branching from hidden capacity and initial heterogeneity. > **Revised manuscript:** Appendices B.2.1 (Example B.1; Figure 5), D.1 (Table 8; Figure 15), and F.3 (Table 21).