- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The goal of this paper is to investigate how to determine if non-invasive medical digital twins are identifiable. More specifically, the authors examine whether hidden physiological states, model parameters, and clinically relevant quantities can be uniquely determined based upon indirect measurements. To address this issue, the authors use a cascade of dynamical systems which separates the "upstream" physiological dynamics from the "downstream" measurement process.
The primary theoretical contributions are a low-order sufficient condition for local observability and structural identifiability that uses specific Lie derivative blocks, and a functional identifiability framework which integrates admissible model reduction with a row-space condition to recover clinical quantities without requiring full-state reconstruction.
The authors evaluate their proposed approach on two types of simulated systems, namely linear and nonlinear cascaded systems, and a digital twin of cerebral hemodynamics built from the ISLES2017 perfusion MRI dataset. The experiments assess computational efficiency, structural ambiguity, and the consistency of regional cerebral blood flow (CBF), cerebral blood volume (CBV), and mean transit time (MTT) among different observationally similar solutions.
Critical strengths
The authors address a significant issue: an accurate reproduction of clinical observations does not guarantee that the actual physiological states or parameters are uniquely identified. The cascaded formulation is a logical approach to separate the dynamic processes involved in physiology from those of measurement. It is beneficial to distinguish between full-state identifiability and functional identifiability because obtaining clinically relevant information can be more practical than obtaining all of the hidden state variables.
The proposed low-order block criterion provides an easily understood sufficient condition for local observability and structural identifiability. The accompanying synthetic experiments explore computational efficiency and demonstrate how individual parts of a cascaded system become observable as the order of their derivatives increases. A cerebral perfusion application demonstrates that the theoretical perspectives presented here may be relevant to physiological modeling.
Critical weaknesses
There is insufficient evidence to support the claim that cerebral blood flow and cerebral blood volume are functionally identifiable, and this claim also appears inconsistent with the model's scaling structure.
In Section 4.2 on the cerebral hemodynamics model, the authors present three different components: 1) a regional effective inflow; 2) an upstream outflow state; and 3) a downstream vascular volume scale. Both target functions CBF and CBV are defined using the effective flow amplitude and volume scale.
Equations (4.1) and (4.3), combined with the parameterization of Appendix E.3, seem to allow for a continuous scaling transformation. A continuous scaling transformation can be constructed by multiplying the effective inflow, upstream outflow, and vascular volume by the same positive constant, while inversely scaling the resistance parameter that determines the initial outflow and leaving the relaxation time and tracer input unchanged. This appears to result in no change in the predicted tracer concentration trajectory. While the individual CBF and CBV values will be different under such a transformation, the ratio between the two (and hence MTT) will remain constant.
The above appears to indicate that neither CBF nor CBV can be uniquely identified on its own through the reported observation model unless there is some additional means of fixing the scale or an independent measurement. The problem is even more significant since the low row-space residual values reported for both quantities in Table 2 are presented as numerical evidence for functional identifiability, yet the apparent scaling ambiguity makes it difficult to reconcile these results.
The fact that the authors used regularization and physiological knowledge to initialize their model does not imply that they have established that the parameters can be uniquely identified based upon the observations of the system alone. This distinction between identifying parameters uniquely from observations (structural identifiability) and using prior assumptions to select one of several possible sets of parameters that are consistent with the observed behavior of the system (prior-based parameter selection) is fundamental to the authors' research questions.
The experimental validation is inadequate to demonstrate that the theoretical criteria are applicable in practice.
Theorem 3.4 offers a low-order certificate under restrictive constraints on the measurement dimension and rank. More specifically, the constraint m >= max(n_D, n_U + q_D, q_U) for the number of observable channels may be difficult to satisfy when considering the non-invasive applications that motivate this work. The primary synthetic examples employ a scalar downstream observable and evaluate trajectory-stacked rank diagnostics, which are explicitly distinct from the pointwise sufficient conditions of Theorem 3.4. Thus, these experiments mainly illustrate cases where low-order certification is not achieved and demonstrate computational savings, rather than establishing how frequently the theoretical certificate applies to realistic medical digital twins.
A large part of the computational comparison is based on the use of selected low-order blocks or a staged procedure, as opposed to constructing a predetermined higher-order observability-identifiability matrix. If there were a direct comparison with an existing incremental rank-testing procedure, it would offer more compelling evidence of the practical computational advantage.
Additionally, the cerebral hemodynamics experiments were conducted with a compartmentally reduced version of the original spatially dynamic system. The fitting procedure utilized regularization priors and initializations derived, in part, from regional perfusion summary statistics. Because of the close association between the summary statistics and the target quantities of interest, the observed stability among the retained minimizers cannot independently demonstrate that the target quantities are functionally identifiable. The current experiments would have been much more useful if they had separated the contributions of observational data, model reduction, initialization, and regularization.
Questions for authors
Can the authors please explain what prevents the following scaling transformation in the cerebral hemodynamics model? The scaling transformation would involve multiplying the effective flow amplitude, upstream outflow, and vascular volume by a common positive factor and inversely scaling the resistance parameter which determines initial outflow, while leaving the relaxation time and tracer input unchanged.
How can the reported row-space residuals be reconciled with the claimed functional identifiability of CBF and CBV if the tracer concentration trajectory is preserved under the transformations described in Equations (4.1) and (4.3), and yet CBF and CBV are changed individually? Are there other observations or hard constraints placed on the parameters in the implementation of the model?
Are the authors able to explain how the regional CBF and CBV summaries used for both initialization and regularization are calculated, as well as whether these overlap with the "silver-standard" estimates presented in Figure 4? I think it would be very helpful if the authors repeated the functional stability analysis with significantly wider ranges of initial parameters and without target-informed regularization. This would enable us to separate structural identifiability from numerical stability provided by prior information.
In regard to the cerebral hemodynamics model, would the authors provide information regarding the dimensions of the observed outputs, known inputs, upstream/downstream states, and unknown parameters? Would the authors also state whether the conditions required by Theorem 3.4 are satisfied? Additionally, could the authors describe how the proposed methodology compares to a standard incremental observability-rank method where the algorithm stops when it has found sufficient rank, without constructing a higher-order matrix in advance?
Since regional compartmental dynamic models are based upon an approximate spatial aggregation of voxels, can the authors assess the effect of this approximation on the identifiability of the original physiological quantities? Specifically, what provides assurance that the clinical target functionals of the aggregated model retain their intended interpretation when applied to the original voxelwise system?
3 comments
W2 / Q4. Does Theorem 3.4 apply in the clinical model, and how does the cascade compare with incremental rank testing?
We tested Theorem 3.4 pointwise and compared it with the incremental rank test as suggested. On the original 18 systems, all five direct-channel systems passed the low-order certificate at order two. Five flat-coupling systems reached full rank at orders three through seven, and eight scalar-aggregate systems remained uncertified through order seven. Incremental OI adds one derivative order at a time and stops at full rank. Both methods used the same differentiation engine, caching policy, rank threshold, evaluation points, and order cap. Villaverde et al. (2019)
The cascade was 2.31× faster on the original suite against early stopping. The original 14.8× speedup used a fixed order-seven baseline. Revised Table 2 and Appendix G report median total times and median paired speedups over six runs.
| Setting | Incremental OI (s) | Cascade reusing (s) | Speedup |
|---|---|---|---|
| Original 18 systems | 0.335 | 0.148 | 2.31× |
| Polynomial cascades, all downstream outputs | 0.516 | 0.128 | 4.04× |
| Same cascades and points, outputs | 1.524 | 1.586 | 0.99× |
Both methods reached the same decision at the same order in all 30 evaluations. With all downstream outputs, both stopped at order two. At , reusing to compute reduced distinct partial derivatives from 160 to 56. With half the outputs, the dimension check triggered incremental testing, and all six points reached full rank at order four. These counts describe the tested readouts. Prevalence across clinical model families remains open.
We remark that, Theorem 3.4 can fail to certify full recovery in clinical models with many latent states or unknown parameters and few measured outputs. This is the case in our perfusion model, where each region provides a single tracer channel (). We therefore introduce functional identifiability to ask which clinical targets the observations can still determine when full recovery cannot be certified (Theorem 3.9). To test the effect of fewer outputs directly, we halved them from to on the same polynomial cascades. All six points still reached full rank, now at order four instead of order two (Appendix G).
W2 / Q5. How well do the regional targets represent the original voxelwise quantities?
Fitting after spatial averaging changed CBF by 3.94%, CBV by 1.05%, and MTT by 8.25% relative to averaging the voxel fits. In four patients, we fitted the same 16 voxels in each of 16 regions per patient both ways (1,024 voxels), holding equations, input, optimizer, and prior centers fixed. For MTT, the voxelwise comparator was the mean of the individual transit times. The fitted tracer trajectories differed by 4.60%. We took medians over regions and then over patients. This pilot quantifies the approximation in the sampled regions. Extending the identifiability guarantee to voxelwise physiology requires compatible regional dynamics and a regional target that preserves the intended voxelwise quantity.
Gentle reminder
Dear Reviewer,
As the rebuttal period draws to a close, we would welcome any further feedback on our responses and revisions. In response to your concerns, we added verification of the scaling symmetry, reference-free diagnostics and regularization ablations, comparisons against incremental OI, and an analysis of the effect of spatial averaging.
We hope these additions help address your concerns and would be happy to discuss any remaining questions. Thank you again for your time and careful review!
Thank you for identifying the scaling symmetry and suggesting an early-stopping baseline. Please see our Global Response for an overview.
W1 and W2 / Q1–Q3. What does the tracer identify, and what role do the Figure 4 reference maps play?
Q1. We agree that absolute CBF and CBV can change while the tracer trajectory and MTT remain identical. In
Eqs. (4.1)and(4.3), multiplying flow and volume by s>0 and dividing resistance by s scales the entire outflow by s at fixed relaxation time and tracer input. To verify this, we doubled flow and volume and halved resistance in all 651 reference-free regional fits. Every tracer value and MTT was preserved exactly. The transformed parameters remained within the fitting bounds in 618 regions, and any interior fit admits sufficiently small rescalings.Q2. The low residuals in the submitted Table 2 (revised
Table 3) are conditional on flow and volume information. We added a clarification inSection 4.2.2explaining how the reference-derived priors anchor the fitted scale and how retaining flow and volume information in the diagnostic distinguishes points along the scaling family. To verify the latter, we changed only the observation information at the same reference-informed fits in 43 patients, keeping input amplitude fixed. The mean residuals were below 0.001% for both targets with flow and volume retained. With the tracer alone, they rose to 61.4% for CBF and 61.8% for CBV.Q3. Yes. The fitting anchors came from the same silver-standard maps displayed in
Figure 4. Within each ROI, the medians of positive CBF and CBV map values set the initialization centers, penalty centers, and parameter bounds. We have removed the caption’s description on these maps "used only for visualization” to avoid potential confusion.We further test how much agreement persists without these anchors: we repeated the fits with tracer-derived centers and wider flow and volume bounds. We retained the original 20-start schedule (from one-third to three times each center at its widest setting). With identical starts and bounds, removing the four soft penalties increased mean pairwise discrepancy from 12.8% to 220.2% for CBF and from 27.2% to 122.9% for CBV. The median patient-level MTT discrepancy rose from 16.2% to 83.7%. A separate four-patient check with common starting centers for all ROIs and zero penalties also gave large CBF and CBV discrepancies (236.4% and 192.6%). Table 12 in revised Appendix H reports the cohort ablation. We derived the tracer-based centers following Tran et al. (2026).
The tracer-only analysis gives partial support for local MTT identifiability at the individual-region level. In the separate seven-parameter compartment analysis, all fitted parameters were free. Mean ROI residuals were 2.3% for MTT, 58.3% for CBF, and 58.7% for CBV (revised Table 4). The MTT residual fell below 1% in 96.9% of individual ROIs and 34.9% of joint patient evaluations.