- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates how to identify mRNA-protein regulatory network dynamics from multi-episode single-cell snapshot data and design early intervention strategies. By leveraging structural zero constraints of the two-modality regulatory network, the authors recast continuous-time system identification as an inverse Lyapunov linear regression problem and establish finite-sample error bounds for the system matrix and dominant spectral projector via cross-episode kernel conditional density estimation. Building on these estimates, the framework ranks candidate regulatory nodes using first-order eigenvalue sensitivity (participation factors) to achieve spectral re-stabilization, validating master-regulator identification on a 90-dimensional synthetic modular network and a 50-dimensional single-cell hematopoietic differentiation dataset.
Critical strengths
-
This paper incorporates structural sparsity priors into the inverse Lyapunov equation, establishing a complete theoretical pipeline with finite-sample error propagation bounds from kernel covariance estimation to the system matrix and its dominant spectral projector (Proposition 1 and Theorems 1–3) without requiring explicit trajectory reconstruction.
-
By leveraging first-order eigenvalue sensitivity analysis (participation factors), the method reduces complex closed-loop pole placement to computationally efficient diagonal node ranking, offering an interpretable criterion for screening candidate intervention targets in dynamical networks.
Critical weaknesses
-
There is a fundamental disconnect between the core identifiability theory and the real biological data experiments. The uniqueness guarantee in Proposition 1 relies entirely on the block-diagonal sparsity structure specific to coupled mRNA-protein networks (which eliminates degrees of freedom to make the Lyapunov system overdetermined), yet the sole biological validation in Section 6 (Paul et al., 2015) contains only mRNA measurements; without protein data, the theoretical block identifiability collapses, forcing the authors to manually pre-select 26 known hematopoietic transcription factors and impose an external Spearman-correlation threshold mask (while similarly feeding the ground-truth Jacobian support mask into the synthetic experiments in Appendix J.3).
-
Modeling normal lineage differentiation clusters as quasi-stationary Gaussian fluctuations around local equilibria is biologically implausible, and the actual implementation deviates from the theoretical formulation. Rather than capturing a disease bifurcation process, the real-data experiment mean-centers and pools 15 distinct normal cell types across divergent branches (erythroid, myeloid, and lymphoid), erasing macroscopic developmental drift; moreover, whereas Theorem 1 relies on a temporal kernel to borrow strength across adjacent stages, the actual weight implementation in Appendix K.3 Equation (32) completely omits , resulting in indiscriminate pooling that dilutes pre-bifurcation critical slowing-down signals.
-
Non-parametric kernel conditional density estimation suffers from a severe curse of dimensionality in high-dimensional spaces, and the control formulation offers limited algorithmic novelty over the authors' prior work. Theorems 1 and 2 require and under a known isotropic Gaussian white noise assumption , which not only contradicts single-cell transcriptional bursting and state-dependent count noise characteristics (Larsson et al., 2019; Sarkar & Stephens, 2021; Gorin et al., 2022), but also becomes statistically intractable due to exponential decay even in the reduced 90-dimensional synthetic space and 50-dimensional real gene panel with only 375 total cells (forcing the authors to hard-code a global bandwidth on -scaled data in Appendix K.3); furthermore, the optimal and diagonal re-stabilization objectives and participation-factor criterion (Equation 10 and Lemma 1) are directly adopted from Yasukata et al. (2023) and Shen et al. (2024a, 2024b).
-
The empirical evaluation is restricted to small-scale static node ranking, lacking closed-loop treatment verification and adequate baseline comparisons. Although motivated by early intervention in high-dimensional () single-cell systems, the experiments only evaluate Top- node identification accuracy in tens of dimensions without demonstrating that applying the synthesized feedback actually re-stabilizes trajectories or prevents bifurcation in the nonlinear system; additionally, the real-data experiment on the pre-filtered 50-gene panel includes no quantitative comparisons against baseline methods (such as scInTime, Shen et al., 2024b, or established single-cell perturbation tools like CellOracle and dynamo).
References
- https://doi.org/10.1371/journal.pcbi.1010492
- https://doi.org/10.1038/s41586-022-05688-9
- https://doi.org/10.1038/s41586-018-0836-1
- https://doi.org/10.1016/j.cell.2021.12.045
- https://doi.org/10.1038/s41588-021-00873-4
- https://doi.org/10.1109/TETCI.2024.3442824
- https://doi.org/10.1016/j.ifacsc.2024.100245
- https://doi.org/10.1002/rnc.6720
Questions for authors
see weaknesses
4 comments
Part 2/3: Identifiability, biological interpretation and the temporal estimator
Part 2/3: Identifiability, biological interpretation and the temporal estimator
The generic block experiment tests the structure used by Proposition 1. It removes the true regulatory support while keeping the mRNA-protein block constraints. The localized results above therefore establish target recovery without the oracle mask. At the population covariances of the true Jacobians, both synthetic restricted operators have full column rank, . Table 8 also reports the synchronous generic-block results: its simultaneous critical modes are not resolved at the fixed validation-selected bandwidth. We distinguish this setting from the synchronous support-prior coverage experiment. Complete recovery of the critical gene's mRNA and protein states is reported separately: top-2 recovery is 20% and 40% at and , and 63% at .
The real-data section now evaluates regulator concordance. The mRNA-only reduction does not inherit Proposition 1's block identifiability. Under the stationary model with isotropic diffusion, the original Spearman mask has a 15-gene component with 137 unknowns but only 120 symmetric equations, giving total operator rank at most 172 for 196 unknowns (App. K.3). Positive empirical rank can result from cross-component covariances due to sampling variation or model mismatch. It does not establish identifiability under that model. The submitted inverse-covariance fit is retained as an explicitly labeled auxiliary result, with its prior, initialization and gene roles stated in Apps. K.3-K.4.
The new study follows the published C7-to-C2 erythroid lineage. Five stage-stratified splits separate 608 prior-training cells, 304 validation cells and 307 evaluation cells per split. GENIE3 uses only the prior-training cells, with all panel genes eligible as regulators. Model sparsity and bandwidth are selected by validation covariance likelihood. Variance uses matched bandwidths and independent validation tuning, including a reference-recovery selector. Each split contributes 20 evaluations with 25 cells per stage; the 100 evaluations are nested within the five splits.
Following the initial mitochondrial-dominance diagnostic, the nuclear-transcript sensitivity analysis removes only Atpase6, leaving 49 genes and the induced subnetwork of the training-derived prior. The fixed references are Gata1, Klf1, Gfi1b, Gata2 and Zfpm1. All 100 fitted systems are stable and their empirical operators have full column rank. Four reference genes appear among the top five with non-negligible scores: Zfpm1 in 38 evaluations, Gfi1b in 27, and Gata1/Klf1 in 18 each. Table O.1 gives the nuclear first-ranked-reference and top-five comparisons. Table O.2 includes the complete panel results; the corresponding full 50-gene dispersion panel gives 10/100 first-ranked references, versus 8/100 for reference-tuned variance.
The Paul data follow normal erythroid differentiation, so this biological comparison tests whether the method prioritizes established regulators of that process. The nuclear panel was examined as a post-hoc follow-up. Its reference genes come from the same literature used to construct the panel and provide an incomplete benchmark. Tables O.2 and O.3 report the complete panel comparisons. The synthetic experiments separately measure how the estimated interventions change local stability.
Temporal kernel and centering. All revised covariance-based synthetic fits use where is the unbiased covariance around the mean of the selected cells of episode (Eq. (7)). The kernel acts on the episode coordinate. Differences between episode means therefore do not enter the covariance, and Gaussian centering costs one degree of freedom without covariance bias (Lemma 2).
The submitted real-data fit omitted this temporal kernel and is not covered by Theorems 1-3. Its direct-estimator diagnostic uses the uniform-weight limit because the original mixed cell types have no single temporal ordering. The new lineage study supplies an explicit stage coordinate and uses the direct estimator. Table 4 distinguishes these procedures. The analysis assumes quasi-stationarity and approximately Gaussian local fluctuations.
Part 3/3: Statistical rate, diffusion assumptions and contribution
Part 3/3: Statistical rate, diffusion assumptions and contribution
The guarantee is derived from the original cells without state-space density estimation. The revised estimator smooths only over the episode coordinate, so the condition no longer arises. Set , , , and . Theorem 2 gives With probability at least ,
The assumptions are explicit: stationary Gaussian cells, independent samples within and across episodes, temporal covariance regularity and a positive population restricted margin. Cross-episode independence is not inferred from destructive measurement. The bound separates sampling error and temporal bias and displays its dimension dependence. Its population constants are not replaced by empirical singular values to claim a data-dependent certificate.
At , the selected bandwidth gives (Table 3). This bandwidth was fixed using an independent validation network before synthetic testing (App. F). For equispaced episodes, and give consistency for any fixed . With dimension and population constants fixed, the leading stochastic term decreases with , while temporal bias is . Thus temporal pooling avoids the spatial bandwidth exponent while retaining an explicit bias-variance trade-off.
Known diffusion and biological noise. The regression accommodates any known constant diffusion covariance : its right-hand side is and the restricted operator retains the same form. The covariance and matrix-estimation bounds continue under their stated assumptions and . Proposition 1 establishes generic identifiability for isotropic diffusion; for another known , the corresponding rank condition must be established separately. This extension concerns process diffusion. State-dependent bursting, unknown diffusion and count measurement noise require additional modeling and are outside the present guarantees.
Contribution relative to the cited control literature. We credit Yasukata et al. (2023) and Shen et al. (2024a, b) for the feedback objectives and simple-eigenvalue sensitivity criterion. Our contribution is the structured recovery of intervention-relevant spectral quantities from snapshot covariances, with identifiability and original-sample estimation bounds and their propagation to participation scores.
For repeated, semisimple critical eigenvalues, the revised Lemma 1 states the required coverage condition through The eigenvalues of determine the first-order shifts; its trace alone does not determine the largest real part. A strict first-order decrease requires , which entails . An uncovered critical mode remains in the closed-loop spectrum for any gain. The synchronous interventions verify this coverage requirement, and the localized generic-block experiment verifies target selection without the oracle mask.
These results connect the stated structural and sampling assumptions to an implemented estimator and to measured closed-loop improvement. Sec. 6 and App. O provide a separate quantitative, exploratory assessment on biological snapshots.
Additional results for weaknesses 1 to 4
Additional results for weaknesses 1 to 4
We posted further experiments in the two comments "Additional experiments for all reviewers" at the top of the forum. The results that bear on your points, with the main numbers:
- Weakness 1, identifiability without protein data (new test). The first step of the proof of Proposition 1 holds for any support that contains the diagonal, so it covers mRNA-only supports: full column rank at one stable matrix gives identifiability for almost every stable system on that support. Each of the five supports of the erythroid analysis has full column rank at 20 of 20 random stable matrices. The submitted Spearman mask does not, as reported in our response.
- Weakness 2, pooling and the pre-bifurcation signal (new measurement). We measured how much pooling with the time kernel dilutes the critical signal. In the true covariances, the critical direction carries about 30 times the variance of the next direction at the pre-disease stage and about 5 times at an earlier stage. Pooling lowers these to about 7 and 2. Recovery follows the same pattern. At the pre-disease stage the method ranks a critical master first in 87% / 98% of localized trials and 44% / 73% of synchronous trials (N = 50 / 70), against 18% / 61% and 16% / 35% for the single snapshot. With 150 cells the synchronous value reaches 97%, against 48%. At earlier stages, where the pooled ratio is about 2, the single snapshot is the better choice, and the revised PDF states (Appendix P.1) that the pooled estimator is meant for the pre-disease stage. This extends our earlier explanation: simultaneous critical modes raise the number of cells needed, and the distance from the transition is the larger factor.
- Weakness 3, dimension and sample size. As stated in our response, the estimator pools over time only, so no density is estimated in the 90-dimensional state space. The new experiments use it with 50 and 70 cells per episode in 90 dimensions, with 2,160 free coefficients.
- Weakness 4, closed loop in the nonlinear system (new test). We applied the feedback to the nonlinear model with noise and moved the threshold 0.6 past the saddle-node. Without feedback, 0% of cells stay on the healthy branch. Feedback with gain -0.5 on the three critical master proteins keeps 100% of cells healthy in the synchronous network, and feedback on the two critical nodes does so in the localized network (on the master protein alone it takes gain -1.0). Feedback on the highest-variance nodes, on scInTime's most frequent pick, or on a master of equal degree in a dormant module leaves the system tipping (0%). The targets are the critical nodes, which the method identifies with the support prior. With targets estimated without it, the test succeeds whenever the selected proteins cover all critical modules, at the coverage rates given below.
- Weakness 4, baselines (new baseline and benchmark). We added a hub baseline with no fitted model: rank the proteins by their total GENIE3 importance. In a new benchmark where the strongest hub is not the critical master, it stays at 0%, and our fit rises from 14% at N = 50 to 62% at N = 300 with no support information (36% to 77% with a learned support). In the original benchmarks the critical master is also the strongest hub, so the hub baseline finds it there in at least 94% of trials. Closed loop without the oracle support, at the pre-disease stage: one estimated protein lowers the dominant eigenvalue of the true localized system in 87% / 98% of trials (N = 50 / 70). The synchronous test is stricter: the three top-ranked proteins have to cover all three critical modules. With the block subspace they do so in 92% of trials at N = 200 and 95% at N = 300, against 24% and 56% for the single snapshot. With fewer cells the rates are 5%, 23%, 46% and 71% at N = 50, 70, 100 and 150 (single snapshot: 0%, 0%, 0% and 7%). With a learned support they do so in 65% at N = 50.
We hope these results address your concerns, and we would be grateful if you would consider raising your score.
Part 1/3: Closed-loop verification and quantitative comparisons
Part 1/3: Closed-loop verification and quantitative comparisons
Thank you for the comments and for emphasizing the importance of testing the selected interventions. We now apply the estimated targets to the true Jacobians, using the same fixed gain for every method.
Three estimated protein targets lower the synchronous spectral abscissa in every trial. Under the stated support prior and gain gi=−0.5, the abscissa falls from −0.2977 to −0.5190 in 100/100 trials at both N=50 and N=70 (Table 1):
One target cannot lower the abscissa when two other modules retain the same critical eigenvalue. The zero entries at l=1, including for true participation factors, agree with the revised coverage condition in Lemma 1. Full module coverage and successful control coincide in the reported trials.
The localized target is recovered and actuated without the oracle mask. Fitting the full biological block subspace, with 2,160 free coefficients and no gene-specific regulatory mask, gives top-1 recovery of 88% and 94% at N=50 and 70, versus 12% and 60% for the single-snapshot fit and 0% for scInTime (Table 8). Actuating one estimated protein lowers the true abscissa in 88% and 94% of trials, versus 11% and 60% for the single-snapshot fit (Table 7). The all-node ranking and protein-restricted intervention endpoints are reported separately.
With the support prior, the proposed single target succeeds in every localized trial at both sample sizes, while degree succeeds in 39% and 34%. All three master proteins have out-degree 15, but only the critical hub changes the abscissa, from −0.1106 to −0.3381 (Tables 6-7). App. J.6 also reports mRNA-only interventions and a gain sweep. At gain magnitude 0.1, the true-projector first-order prediction differs from the achieved margin by less than 4% in both networks (Table 9).
Quantitative real-data comparison. We have added a new C7-to-C2 erythroid analysis using separate cells for prior training, validation and evaluation. In the post-hoc nuclear-transcript panel, an established reference regulator is ranked first in 29/100 evaluations, versus 15/100 for matched or likelihood-selected variance and 19/100 for reference-tuned variance. Prior out-degree and GENIE3 outgoing importance each give 0/100 for this endpoint. Mean non-negligible reference hits among the top five are 1.01, compared with 0.78, 0.80 and 0.81 for the variance controls (Table O.1). Part 2 specifies the design and interpretation; Table O.2 reports the panel comparisons.
Intervention scope and other tools. The closed-loop tests directly measure the spectral-abscissa criterion in Problem 1. Testing whether the same interventions prevent tipping along nonlinear Hill-SDE trajectories is a further evaluation. We identify this as future work, with the intervention time, parameter path and tipping criterion fixed in advance.
The added biological benchmarks compare variance and training-derived prior rankings. CellOracle infers context-specific regulatory networks and then predicts the expression and cell-identity response to a specified TF perturbation. Our method addresses an inverse problem: recovering continuous-time local dynamics from snapshot covariances, then using the estimated critical modes to select intervention targets. We evaluate those targets by their effect on the spectral abscissa under diagonal feedback. CellOracle's forward perturbation predictions do not directly provide this Jacobian-based identification and control test. The dynamo vector-field workflow uses RNA-velocity information, which is unavailable in this expression-only analysis.
Scale. The block fit has p=n2+3n unknowns, or 2,160 at n=45. App. N reports approximately one hour on the specified laptop CPU for the block benchmark with 100 trials over seven sample sizes. This is a panel-scale implementation; genome-wide fitting would require additional sparsity and sparse/operator-based solvers.