- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes M2M-FSurv, a multimodal framework for continuous-time competing-risks survival prediction. It integrates clinical notes, longitudinal physiological measurements, and structured covariates through modality-specific encoders and attention-based fusion, followed by B-spline prediction heads that estimate cause-specific event-time distributions. The authors provide a theoretical consistency analysis and evaluate the method on MIMIC-III and METABRIC.
Critical strengths
- The paper addresses a clinically relevant problem by combining heterogeneous patient information with continuous-time competing-risks prediction.
- The B-spline formulation provides smooth, continuous-time event predictions while ensuring valid cumulative incidence functions by construction.
Critical weaknesses
- The multimodal architecture largely follows established encoder–fusion paradigms. The B-spline prediction head appears to be the more distinctive contribution, yet its motivation remains underdeveloped. In particular, the paper does not clearly establish why B-spline representations are preferable to existing parametric or discrete-time survival models, or which properties are particularly valuable for the target clinical setting.
- The consistency result applies only to a restricted feedforward B-spline estimator, rather than the implemented M2M-FSurv architecture. Moreover, it does not establish any specific statistical advantages of B-spline representations over alternative continuous-time survival models, leaving its relevance to the proposed method unclear.
- The evaluation omits SAMVAE, a closely related multimodal continuous-time competing-risks method explicitly discussed in the paper. Furthermore, the experiments do not isolate the contribution of the B-spline prediction head from the multimodal architecture.
- METABRIC involves scalar-only, single-event prediction and therefore cannot validate the proposed multimodal fusion or competing-risks modeling. While it offers additional evidence of general survival prediction performance, it does not isolate the benefits of B-splines. Moreover, the justification that classical survival methods cannot handle multimodal inputs is questionable: Methods such as Cox regression and DeepSurv can be combined with multimodal representations and could also serve as baselines on MIMIC-III.
Questions for authors
- What specific advantages of B-spline representations motivate their use over existing parametric and discrete-time survival models?
- What insights does the consistency analysis provide about the implemented architecture?
- Why is SAMVAE excluded from the comparisons? Could the authors provide controlled comparisons using the same multimodal encoder with alternative survival prediction heads (e.g., parametric or discrete-time) to isolate the contribution of B-splines?
7 comments
Response to Weakness 1 (part 2)
Although the B-spline head did not achieve the lowest mortality IBS over the entire prediction horizon, it achieved lower Brier scores at both 24 and 72 hours compared with the discrete-time and log-normal mixture heads (Table 1 ).
These findings suggest that the B-spline representation provides benefits not only in cause-specific discrimination but also in short-horizon prediction accuracy. The difference between the horizon-specific Brier scores and the overall IBS highlights the importance of evaluating prediction quality at clinically relevant time points rather than relying exclusively on an integrated metric over the full prediction horizon.
Overall findings. Our motivation for using B-splines is not that alternative survival formulations are incapable of modeling complex event-time distributions, but that B-splines offer a locally supported, smoothly varying representation with explicit control over temporal resolution through knot placement. Coupled with joint competing-risks probability normalization, this provides a structured formulation for continuous-time cause-specific event-density prediction. The additional controlled experiments demonstrate that this design choice makes a measurable contribution to cause-specific discrimination beyond the shared multimodal architecture.
We will strengthen this motivation and clarify its relevance to the ICU competing-risks setting in the revised manuscript.
Response to Weakness 2
We thank the reviewer for highlighting the need to clarify the relationship between our theoretical analysis and the implemented M2M-FSurv architecture. To address this concern, we have revised the theoretical analysis to provide two complementary results covering the Transformer-based prediction architecture, the normalized B-spline heads, and the role of the ranking objective.
Fixed-model theoretical guarantee. Revised Theorem 4.1 establishes a fixed-model population-risk guarantee for a finite Transformer architecture with a fixed B-spline basis and a fixed positive ranking weight. Under the stated bounded-input, compact-parameter, masking, and sampling conditions, the analysis derives uniform complexity bounds covering masked attention, residual connections, LayerNorm, pooling, and both softmax prediction heads.
For i.i.d. patient clusters with uniformly bounded numbers of stays, the theorem establishes convergence to the optimal value of the combined population objective induced by the specified sampler and numerical loss reductions within the fixed model class. This requires the uniform deviations and the global minimization gap for the conditional expected training criterion to vanish. Importantly, this result accommodates a fixed positive ranking weight and does not require the true event-time distribution to belong to the fixed model class.
Approximation and complexity of normalized Transformer models. We further establish a constructive approximation result for an explicitly specified normalized Transformer family. This result accounts for the Transformer operations and the event-probability and B-spline mixture softmax heads. Under the stated smoothness, positivity, and architectural conditions, we show that the approximation error for cause-specific event-time densities can vanish while the model complexity remains controlled as the network dimensions and spline basis size increase.
These results extend the original analysis beyond the restricted feedforward coefficient class and provide a theoretical foundation for the normalized neural B-spline formulation.
Scope and limitations. We distinguish fixed-model population-risk optimality from consistency for the true cause-specific event distributions. A nonvanishing ranking objective may alter the population optimum; therefore, truth-consistency additionally requires the stated censoring conditions, vanishing optimization error, and a vanishing ranking perturbation. The growing-family approximation result does not establish universal truth consistency for the fixed architecture and spline dimension used in our experiments. Application of the fixed-model guarantee to the reported runs remains conditional on matching the analyzed computational graph, preprocessing, sampler, and numerical loss reductions. Moreover, the results do not guarantee global convergence of AdamW.
Overall findings. The revised analysis provides theoretical support for the Transformer-based normalized B-spline formulation under explicit conditions, while distinguishing its fixed-model optimization properties from asymptotic recovery of the true event-time distributions. Together with the controlled prediction-head experiments, these results strengthen the theoretical and empirical justification for our proposed modeling framework without claiming unconditional consistency or theoretical superiority over alternative survival models.
Response to Weakness 1 (part 1)
Thank you for highlighting the need to better motivate our B-spline formulation and clarify its methodological contribution. We agree that the modality-specific encoders and Transformer-based fusion build upon established architectures. Our primary contribution lies in the construction of continuous-time cause-specific event distributions, rather than in introducing new multimodal encoding components.
Motivation for B-spline event-time modeling. In our ICU competing-risks setting, we aim to estimate the timing of two mutually exclusive outcomes—alive ICU discharge and in-ICU death—following the 24-hour landmark. The corresponding event-time distributions may exhibit distinct temporal patterns across patients and competing outcomes, motivating a flexible representation that can accommodate locally varying density shapes.
Existing survival formulations offer different modeling trade-offs. Discrete-time approaches represent event probabilities over predefined time intervals, with temporal resolution determined by the chosen discretization. Parametric continuous-time approaches provide event-time predictions without discretization but impose distributional structure through their selected parametric families. Although flexible parametric mixtures can represent complex distributions, their density shapes are governed by the chosen distributional components.
In contrast, B-splines provide a locally supported basis representation of smooth event-time densities, allowing different regions of the prediction horizon to vary without imposing a particular global parametric distributional shape.
Relevance to the ICU setting. The local support of B-splines is particularly useful for representing event-time variation across different post-landmark periods. Moreover, the spline degree, basis dimension, and knot placement provide explicit control over representation flexibility and temporal resolution. In our implementation, we use non-uniform knots, allocating greater resolution to the earlier post-landmark period and a coarser representation to the sparsely observed tail. This allows the event-time representation to accommodate temporal variation while retaining a structured, smooth functional form.
Our formulation also directly represents continuous-time cause-specific event densities, from which cumulative incidence functions can be evaluated at arbitrary times through integration. Furthermore, patient-specific nonnegative B-spline coefficients and joint probability normalization ensure nonnegative cause-specific densities, nondecreasing cumulative incidence functions, and valid competing-risks probabilities by construction.
Empirical validation of the modeling choice. To assess whether these representational properties translate into predictive benefits, we conducted additional controlled head-replacement experiments comparing B-spline, discrete-time probability, and continuous-time log-normal mixture prediction heads. All configurations retained the same multimodal encoders, Transformer fusion architecture, input representations, data partitions, and prediction horizon.
With ranking loss, the B-spline head achieved the highest Ctd-index for both alive ICU discharge (0.788) and in-ICU death (0.866), compared with the discrete-time head (0.729 and 0.775) and the log-normal mixture head (0.751 and 0.782). The B-spline head also maintained the highest observed concordance without ranking loss, indicating that its discrimination advantage is not solely attributable to the ranking objective.
These findings provide empirical support for the B-spline modeling choice in terms of cause-specific discrimination, beyond the use of continuous-time prediction alone. We acknowledge that alternative heads achieve lower mortality IBS in some configurations; therefore, our results support an advantage in cause-specific discrimination under the evaluated setting rather than universal superiority across all prediction metrics.
Prediction accuracy at clinically relevant horizons. To compare short-horizon mortality probability-prediction accuracy, we evaluated cause-specific Brier scores (BS) at 24 and 72 hours after the landmark, using the same held-out test data and evaluation protocol across all three prediction heads.
Table 1: Comparison of mortality Brier scores (BS) at clinically relevant prediction horizons after the 24-hour landmark.