- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces MeCoGen, a hybrid mechanistic–generative framework for out-of-time forecasting of single-cell populations. The method is evaluated on human iPSC-to-cardiomyocyte differentiation, mouse fibroblast reprogramming, and human pancreatic endocrine differentiation.
Critical strengths
The proposed framework attempts to integrate biological regulatory knowledge with generative modeling, and the authors evaluate it on three temporal single-cell datasets with comparisons to existing forecasting methods.
Critical weaknesses
1. Unclear methodological presentation and insufficient specification of key components.
The writing and methodological organization are highly confusing, making it difficult to reconstruct the actual model from the main text alone. For example, Section 4.1 describes how a predefined signed GRN is incorporated into stochastic dynamics through Hill-type regulatory functions, but does not adequately explain how the GRN itself is constructed. It remains unclear what data or biological evidence are used to select the core genes and regulatory interactions, and whether the complete GRN specifications are available for reproduction. Furthermore, although Section 4.1 briefly mentions post-simulation calibration, the main text does not clearly explain the complete forecasting pipeline. Appendix E introduces two important post-mechanistic calibration components, M3 and D3, which directly modify the structured condition supplied to the downstream generator. These components constitute a substantial part of the actual method but are largely relegated to the appendix. Consequently, several key methodological details only become apparent after reading the supplementary material, making the proposed framework difficult to understand and evaluate.
2. Heavy reliance on manually specified biological priors and insufficient evidence of generalizability.
The reported results are not sufficiently convincing to establish the generalizability of the proposed framework. MeCoGen relies on prior gene-regulatory knowledge and manually curated developmental-state transition structures, which are specified separately for each dataset. This substantially limits the applicability of the approach, as applying MeCoGen to a new biological system would require reconstructing the corresponding regulatory network, developmental states, and transition topology. The paper does not demonstrate how these priors could be obtained systematically or how sensitive the model is to their quality. Moreover, even if the method is intended for a specific biological setting, such as iPSC differentiation, the experiments do not evaluate generalization across multiple independent datasets from the same setting. As a result, the current results primarily demonstrate performance on individually configured datasets, providing limited evidence that the proposed framework can generalize to new data or biological contexts.
3. Missing ablations for the post-mechanistic calibration components and insufficient isolation of the mechanistic contribution.
The post-mechanistic calibration pipeline contains two substantial components, M3 and D3, but their individual contributions are not evaluated. Since the final conditioning state is obtained only after these calibration and refinement stages, it is unclear how much of the reported improvement originates from the underlying mechanistic dynamics and how much is attributable to the subsequent data-driven corrections. In particular, M3 explicitly calibrates gene occurrence probabilities and expression magnitudes using empirical training distributions, while D3 employs an additional discrete diffusion model to refine multigene occurrence dependencies. These operations can substantially alter the expression distributions produced by the original mechanistic simulator. The authors should compare the raw mechanistic simulator (M0), M0+M3, and M0+M3+D3 under identical evaluation settings. Additional ablations removing or perturbing the GRN interactions would also be necessary to establish whether the proposed mechanistic dynamics provide meaningful predictive advantages over simpler state-transition models.
4. Potentially unfair baseline comparisons and confounding effects of gene-expression sparsity.
The comparison with existing methods raises concerns about whether the reported improvements genuinely reflect better temporal forecasting. MeCoGen explicitly separates gene occurrence and expression magnitude, whereas the compared methods primarily generate continuous expression values. As shown in Figure 2 and Appendix I.4, the generated gene occurrence rates of scIMF and scNODE are nearly 1.0, compared with approximately 0.5 in the real data. This discrepancy may arise partly from the inability of continuous generators to produce exact zeros, rather than from a failure to learn the underlying temporal dynamics. Consequently, a substantial portion of MeCoGen's advantage in zero-fraction error, marginal distribution metrics, and gene co-occurrence statistics may be attributable to its explicit sparsity modeling. The paper does not adequately disentangle improvements in temporal forecasting from improvements in expression-distribution modeling. A more convincing evaluation would include baselines with comparable zero-expression handling or training-only calibrated postprocessing, together with comparisons of positive-expression distributions and other metrics less directly affected by exact-zero occurrence.
5. Limited transcriptomic coverage and insufficient validation of the claimed high-dimensional forecasting capability.
Although the paper repeatedly emphasizes high-dimensional transcriptomic generation, the experiments only generate 200 downstream genes in addition to approximately 33–45 mechanistically modeled core genes. This represents a small subset of the transcriptome, and the downstream genes are selected from highly variable genes. Therefore, the current experiments do not establish whether the proposed framework can scale to realistically sized single-cell transcriptomic profiles containing thousands of genes. The relatively small output dimension also makes it difficult to assess the necessity and scalability of the proposed generative architecture. Experiments with substantially larger gene panels, together with analyses of computational scalability and prediction accuracy across genes with different expression characteristics, would be needed to support the broader claims.
6. Limited methodological novelty and insufficient justification for the complexity of the proposed framework.
The proposed framework largely combines established methodological components, including stochastic GRN modeling, predefined developmental-state transitions, discrete diffusion, conditional flow matching, and distributional calibration. While their integration is potentially useful, the paper does not sufficiently demonstrate why this particular combination is necessary or what fundamental methodological advance it provides over simpler alternatives. For example, the experiments do not establish whether a simpler model using the same developmental-state priors and empirical state-conditioned gene-expression distributions could achieve comparable forecasting performance. Similarly, the generator ablations demonstrate the benefit of joint occurrence and magnitude modeling, but do not establish the necessity of using discrete diffusion and flow matching specifically. Without stronger comparisons against simpler, prior-matched alternatives, the methodological contribution remains insufficiently substantiated for ICLR.
Questions for authors
-
Construction of biological priors: How are the core regulatory genes, signed GRN interactions, and developmental-state transition topologies determined for each dataset? What specific data sources or biological evidence support these choices? Can the authors provide the complete GRN specifications and a reproducible procedure for constructing these priors?
-
Generalizability: How would MeCoGen be applied to a previously unseen dataset or biological system for which a curated GRN and developmental-state topology are unavailable? Have the authors evaluated the model across independent datasets from the same biological setting, or investigated its sensitivity to incomplete or incorrect biological priors?
-
Contribution of individual mechanistic components: Can the authors provide ablations comparing M0, M0+M3, and M0+M3+D3? How much of the performance gain can be attributed to the stochastic GRN dynamics, rather than the predefined developmental topology and subsequent empirical calibration? Would a simpler state-transition model with the same calibration pipeline achieve comparable results?
-
Fairness of baseline comparisons: Given that the baseline methods produce almost entirely nonzero expression profiles, how much of MeCoGen's improvement is attributable to its explicit modeling of gene-expression sparsity? Can the authors provide comparisons using consistent zero-expression handling or appropriately calibrated continuous-generation baselines?
-
Scalability and architectural necessity: Why are only 200 downstream genes considered? How does the framework scale to thousands of genes? Additionally, can the authors justify the necessity of combining discrete diffusion and conditional flow matching by comparing against simpler conditional generative models under the same mechanistic conditioning?
Thank you for the detailed responses and the substantial additional experiments. The rebuttal meaningfully strengthens the empirical support for the framework and addresses several of my original concerns.
In particular, applying the same M3 calibration to both conditioning predictors while holding the downstream generator fixed provides stronger evidence that the forecasting advantage is not explained by calibration alone. The same-topology Markov-chain comparison and regulatory perturbations further support the value of the proposed state dynamics beyond the supplied developmental graph. The sparsity-calibrated baseline comparisons and positive-expression evaluations also substantially alleviate my concern that the improvements primarily reflect differences in zero handling.
I also appreciate the expansion to 2,000 downstream genes, the independent training repetitions, and the explanations and corrections concerning cross-table discrepancies. Removing D3 simplifies the framework and makes the contribution of the remaining components clearer.
Some reservations remain. Application to a new biological system still requires system-specific regulatory and developmental priors, and the proposed curation workflow does not yet establish transferability across independent datasets. Moreover, the conditional generator’s reliability for states absent from training remains uncertain, as the authors acknowledge. The evidence is therefore stronger for forecasting within a specified biological setting than for general extrapolation to previously unseen cellular states. The methodological contribution also remains primarily an integration of established components, although the additional controlled experiments now provide a more convincing justification for that integration.
Overall, the additional evidence has sufficiently alleviated my main concerns about contribution attribution and empirical validation. I therefore raise my rating from 2 (Weak Rejection) to 3 (Weak Acceptance), while retaining the above reservations regarding generalizability and the scope of the extrapolation claims.