- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Projected SFBD, which incorporates physiological domain constraints into the projection updates of distribution recovery, enabling recovery of the latent trajectory distribution of sparse, irregular medical time series without complete reference samples. The authors provide a conditional convergence guarantee and, through experiments on MIMIC-III and the Pulse simulator, demonstrate the method’s advantages in distribution recovery as well as in hypotension event detection, severity estimation, and recurrence count estimation.
Critical strengths
-
The paper addresses distribution recovery under sparse medical observations and leverages domain knowledge to reduce reliance on complete reference samples, which offers clear practical value.
-
Beyond distributional metrics such as Energy Score and Variogram Score, the paper evaluates clinically relevant tasks, including hypotension detection, severity estimation, and event recurrence counts, and validates the method’s effectiveness through ablation studies.
Critical weaknesses
-
Please further show that the practical recording-condition projection satisfies Assumption 2, and clarify to what extent the theoretical convergence guarantee applies to the implemented algorithm.
-
I suggest comparing performance with and without the projection while keeping prediction positions, architecture, training budget, and noise settings identical, to establish whether the constraint projection is the main source of improvement.
-
It would be helpful to demonstrate, through theoretical analysis or controlled experiments, that the proposed physiological constraints genuinely improve distributional identifiability, rather than merely shrinking the feasible trajectory space.
I would consider raising my score if these concerns are adequately addressed.
Questions for authors
See Weaknesses.
2 comments
Q4. It would be helpful to demonstrate, through theoretical analysis or controlled experiments, that the proposed physiological constraints genuinely improve distributional identifiability, rather than merely shrinking the feasible trajectory space.
A: We have added a toy example immediately after Definition 1. It shows two distributions that produce identical records and are therefore indistinguishable from the data, although every individual value in both is physiologically plausible. A physiological constraint rules out the distribution that pairs values in an impossible way (MAP above SBP) and keeps the true one. Identifiability is thus restored not by narrowing the range of individual values, which are all plausible, but by excluding combinations of values that cannot occur together.
Empirically, the with/without-projection comparison in Table 1 (see our response to Q3) supports the same mechanism. Both variants are trained on the same charts, and their outputs are compared directly against bedside-monitor references, which serve as ground truth and are never used in training. Projected SFBD achieves better scores at every window length, indicating that projection learns a distribution closer to the truth and providing indirect evidence that the constraints improve identifiability in practice. The Pulse results against known truth (Table 4) point in the same direction.
Thank you for the comments
Thank you for your constructive comments. We address the points raised below and provide the additional results requested.
Q1. Please further show that the practical recording-condition projection satisfies Assumption 2.
A: Assumption 2 requires that projection leave the true distribution unchanged. Our implementation satisfies this whenever true trajectories obey the constraints. Notably, these constraints are not modelling choices that may or may not hold; they encode established physiology. The ordering DBP ≤ MAP ≤ SBP follows from the definition of mean arterial pressure as the time average of arterial pressure over the cardiac cycle, which necessarily lies between its minimum and maximum, and channel bounds such as SpO$_2 \le 100%$ are physical limits. True trajectories therefore satisfy them, and Assumption 2 holds exactly for these constraints. Consistent with this, on the Pulse simulator the true trajectories never violate the BP ordering (0.000% of cells). In an audit of MIMIC-III charts, only 0.29% of co-observed pairs violate it, mostly due to timing and aggregation artifacts; these recorded values remain unchanged. The MAP band and the minimum pulse pressure encode the standard clinical approximation MAP ≈ DBP + (SBP − DBP)/3 and a physiological lower limit on pulse pressure. We impose them with tolerances calibrated on reference data, which absorb measurement noise, so Assumption 2 holds approximately for these two, with violation rates of at most about 1% on arterial measurements: 0.68% for the pulse-pressure floor, and the MAP tolerance is set at the 99th percentile of the arterial residual (Appendix C.2).
Q2. To what extent the theoretical convergence guarantee applies to the implemented algorithm.
A: Regarding the scope of the guarantee, Theorem 1 applies to the implemented update rule, including the adaptive replacement fraction, skip rule, and projection. The only departure from the theory is the error signal: Eq. 7 uses a difference of KL divergences, which requires densities and cannot be estimated directly from samples, whereas the implementation uses the corresponding difference of MMD$^2$ values, which admits an unbiased sample estimator. This substitution preserves the essential convergence structure: with a characteristic kernel, MMD vanishes if and only if the compared distributions coincide, exactly when the KL criterion vanishes, so the two criteria share the same optimum. (Also see the newly added discussion at the end of sec 4.2.) The update rule also keeps the accepted MMD errors summable, mirroring the condition in Theorem 1. To verify convergence empirically, we added Appendix D.6. Theorem 1 guarantees that trajectories drawn from the learned distribution, when recorded in the same way as real charts, reproduce the distribution of the observation records. We test this on records the model never sees: about 15% of each stay’s chart values are held out from training, and we measure how well the model predicts them using CRPS. As shown in Appendix D.6, held-out CRPS decreases steadily, from 0.504 to 0.206 for vital signs and from 0.530 to 0.268 for laboratory values, showing that the fit to the observation records keeps improving, as the theorem predicts. CRPS does not reach zero because the held-out values are not fully determined by the remaining observations.
Q3. I suggest comparing performance with and without the projection while keeping prediction positions, architecture, training budget, and noise settings identical, to establish whether the constraint projection is the main source of improvement.
A: We have added SFBD without projection to Tables 1 and 2, keeping the prediction locations, architecture, training budget, and noise settings identical to isolate the effect of projection. Projection improves every score: ES and VS decrease across all window lengths (e.g., 1 h ES: 0.920 → 0.903; 6 h ES: 2.470 → 2.430), while all downstream metrics improve, including AUROC (0.926 → 0.935), sensitivity at 90% specificity (78.6% → 81.9%), severity bias (−3.17 → −0.61 mmHg), severity MAE (7.07 → 5.63), and episode-count MAE (1.64 → 1.58). The matched ablation in Table 7 further confirms these gains, with CRPS decreasing from 0.227 to 0.216 and coverage increasing from 0.772 to 0.832. While the SFBD framework accounts for much of the improvement over external baselines, projection provides consistent additional gains, particularly in estimating the severity of hypotensive events, where blood-pressure constraints are most relevant.