- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a neural Kalman framework that integrates RNA-seq data, demographic information, and longitudinal clinical records to predict survival risk. It uses a neural encoder to map irregular clinical visits into a state space, with explicit Kalman covariance propagation. This results in a clinical Cox risk, which is then combined with the molecular Cox risk learned from the RNA-seq data and static covariates to make the prediction. However, the paper has several issues, including insufficient experimental validation and the lack of innovation in its methods.
1.The model was validated using a cohort of only 556 patients, with just 95 recorded deaths; given the limited scale of the experiment and the lack of data diversity, the results are not particularly convincing.
-
Recurrent Kalman Networks (RKN)(Becker et al., ICML 2019) is a general-purpose approach to temporal modeling; its mechanisms for neural observation encoding, latent state covariance propagation, and Kalman updates are highly relevant to the present work. However, it was not discussed in the paper.
-
The performance comparisons focus primarily on Static Molecular and RNA+GRU. The comparison is rather limited. RNA+RKNs and more closely related methods, like pretrained sequence encoders, contrastive sequence learning methods, should also be included in the discussion and in the evaluation and comparison.
-
The static molecular branch employs an ensemble of two MLP Cox predictors with differing regularization strengths; however, the motivation for this approach and its implementation details are not sufficiently addressed.
-
Although the fusion coefficients \lambda and \alpha are chosen based on the inner-layer OOF predictions, the selection procedure, and more importantly, the effectiveness of using such a simple linear combination method, remain unclear.
Critical strengths
A neural encoder is used for the sequential state estimation, mapping irregular clinical visits into a low-dimensional clinical-state space with Kalman covariance propagation.
Critical weaknesses
- The motivation of using a Kalman state estimator (instead of the popular methods such as Transformers) is not clearly stated. It is also unclear why 'covariance-aware' is crucial for this case. 2.The molecular Cox risk and the clinical Cox risk are learned independently. It's not clear how each of them and their linear combination contributes to the prediction.
- Some key technical details are missing, including the two compact MLP Cox predictors, E(.) in Eq.(5), the static representation s_i and the observation mask m_it, etc.
Questions for authors
What's the point of being 'covariance-aware', and why can't they be learned by other state estimators?
4 comments
Response to Reviewer Rc9U
Q3.Motivation for covariance-aware state estimation and why it cannot be easily learned by other state estimators
A3. This is a central question of our work, and we thank the reviewer for pushing us to articulate this motivation more sharply. The necessity of explicit covariance-aware state estimation stems from the structural mismatch between longitudinal clinical follow-up records and general-purpose sequence encoders:Why general sequence models struggle to learn temporal weighting from scratch:Longitudinal clinical trajectories differ fundamentally from dense natural language or sensor streams: each patient has only a handful of visits (a median of 4 visits in our cohort), separated by highly irregular time gaps (14 to 218 days) with frequent missing measurements. Standard sequence models (such as Transformers and GRUs) or unconstrained learned-gate estimators attempt to infer temporal decay and measurement reliability implicitly through attention weights or gating parameters. Under moderate clinical sample sizes and right-censored survival supervision, learning these uncertainty-weighting dynamics purely from scratch is data-inefficient and prone to overfitting.What being "covariance-aware" provides mechanically:Our framework embeds a well-founded physical inductive bias directly into the latent state recursion rather than asking a network to rediscover it from sparse data:Time-aware prior uncertainty expansion: Process uncertainty grows monotonically with the elapsed interval between visits, which expands the predicted prior covariance after long follow-up gaps and formalizes the clinical reality that a patient's unobserved state becomes less certain over longer intervals.Analytical uncertainty-calibrated correction: The Kalman gain is computed analytically from the ratio of prior prediction covariance to measurement covariance R. Consequently, when a new clinical visit arrives after a long gap, the expanded prior uncertainty automatically assigns higher weight to the incoming observation; conversely, when visits are closely spaced, the filter smooths noisy measurements against the prior state without requiring extra learnable gating parameters.Empirical evidence that other state estimators cannot replicate this behavior as effectively:We verified this advantage through three sets of controlled comparisons under identical clinical inputs, observation masks, normalized visit times, and inter-visit intervals:Against attention and recurrent sequence encoders (Appendix A & Appendix H, Table 9): In the clinical-only setting, CovarianceKalman achieves a C-index of 0.6616 compared with 0.6238 for the time-aware Clinical Transformer and 0.6320 for Clinical GRU. In the multimodal setting, RNA+CovarianceKalman reaches 0.7160, outperforming both RNA+Transformer (0.6990, +0.0169 mean paired gain, winning all 5 repeats) and RNA+GRU (0.7022, +0.0137 mean paired gain, p = 0.006, winning all 5 repeats).Against RKN and unconstrained learned-gate estimators (Appendix E, Table 7 & Section 4.6): In a matched five-repeat evaluation, RNA+CovarianceKalman (0.7191) outperforms a time-aware Recurrent Kalman Network adaptation (0.6901, +0.0290 gain, winning all 5 repeats). Even when keeping the exact same state-prediction backbone and replacing only the covariance-derived gain with a learned constant gain (0.7079) or a learned time-dependent gain driven by inter-visit intervals (0.7035), performance drops by 0.0112 and 0.0156 C-index, respectively.Under test-time missing observations (Appendix D, Table 6): When randomly masking 10%, 30%, and 50% of observed clinical feature values at test time without retraining, RNA+CovarianceKalman retains a C-index of 0.7051 even at 50% missingness (compared with 0.6912 for RNA+GRU), demonstrating that explicit covariance propagation and observation masking provide superior robustness for sparse, irregular clinical survival trajectories.
Response to Reviewer Rc9U
Q4. Multimodal fusion mechanism and branch contributions
A4.We have added full details of the molecular ensemble and multimodal fusion design in Appendix C and Appendix I, with ablation studies quantifying their contributions. Two-MLP molecular ensemble: The design is motivated by overfitting risk for high-dimensional RNA-seq features in a moderate-sized cohort. We use two single-hidden-layer MLP Cox predictors with distinct capacities and regularization strengths (RNA Strong: width 32, dropout 0.28, weight decay 0.015; RNA Light: width 16, dropout 0.35, weight decay 0.025). Their blend weight λ is selected by grid search exclusively on inner-fold out-of-fold predictions, with no access to test data. The ensemble achieves a mean C-index of 0.6623, outperforming both individual components (0.6556 and 0.6348), as shown in Appendix C (Table 5). Multimodal fusion mechanism: Both branches are trained independently with Cox partial likelihood, and their outputs represent standardized log-hazard risk scores. Linear fusion therefore corresponds to an additive log-hazard model, which is statistically interpretable and has minimal parameters to avoid overfitting. The fusion weight α is selected by grid search over {0, 0.05, ..., 0.70} strictly on inner-fold OOF predictions within each training partition, and fixed before evaluation on the outer validation fold. This procedure ensures no test leakage. As shown in Appendix I (Table 10): Used alone, the molecular branch achieves 0.6623 and the clinical branch achieves 0.6616. Linear fusion raises the C-index to 0.7160, demonstrating strong complementary prognostic information between the two modalities. The performance gain is robust across a range of fixed fusion weights and even a nonlinear max-risk rule, confirming the gains come from complementary signals rather than weight tuning.
Q5. Missing technical definitions and implementation details
A5.We apologize for the missing technical definitions in the original manuscript. We have expanded Appendix B and Appendix J to provide complete, self-contained specifications of all architectural components and symbols. For clarity, we summarize the key definitions below: Static representation s_{i}backslash (Eq. 2): Concatenation of 32 training-fold PCA components (from the 3,000 most variable RNA-seq genes), age, an age-missingness indicator, and one-hot encoded sex variables. Observation mask m_{i,t}(Eq. 2): A binary feature-level vector indicating which clinical variables are observed at visit t for patient i. A separate sequence-validity mask marks padded sequence positions, which do not trigger state updates. Observation encoder E_{\phi }\left(\cdot \right) (Eq. 5): Maps the concatenated input vector u_{i,t} (clinical values, mask, normalized visit time, normalized inter-visit interval) into the 16-dimensional latent state space. The architecture is: linear projection (24 units) → LayerNorm → ReLU → dropout (rate 0.05) → final linear projection (16 units). Molecular ensemble: Two single-hidden-layer MLP Cox predictors with the specifications detailed above, combined via inner-OOF-selected weight λ.
Thank for your effort in the rebuttal. Considering the full discussion, including your responses to other reviewers, I will keep my score as is.
Response to Reviewer Rc9U
We thank the reviewer for the insightful feedback and for highlighting the sequential state-estimation design of our clinical encoder. To clarify the scope of our contributions more precisely: our work centers on scenario-specific methodological design and systematic empirical validation for sparse, irregular clinical survival prediction, rather than proposing a revision to general Kalman filtering theory. Specifically, we couple learned clinical representations with explicit elapsed-time-dependent covariance propagation and analytical Kalman correction, and systematically verify its advantages over mainstream sequence models, state-space baselines, and learned-gate alternatives under a rigorous leakage-controlled evaluation framework. Below we respond to each specific concern in detail.
Q1. Cohort scale and result generalizability
A1.Thank you for your valuable comments. We would like to provide context for the cohort scale and additional evidence supporting the reliability of our findings. First, the MMRF CoMMpass study is the largest and most comprehensively profiled public cohort for multiple myeloma with matched longitudinal clinical records and RNA-seq data. The 95 observed death events in our 365-day landmark subset are consistent with the typical scale of deep learning survival studies using this cohort and landmark design. For Cox proportional hazards modeling with moderate-dimensional predictors, this event count provides sufficient statistical power for the within-cohort comparative analyses we present. Second, our evaluation design is constructed to minimize overfitting and maximize result reliability: All preprocessing, feature selection, and hyperparameter tuning are strictly confined to training folds, with no data leakage into evaluation partitions. We use five repeated nested cross-validation runs with stratified sampling to ensure stable performance estimates. All performance gains are consistent across repeated runs and validated through paired statistical tests and patient-level bootstrap analyses.
Q2.Recurrent Kalman Networks and expanded sequence comparisons
A2. We thank the reviewer for this constructive suggestion. In the original submission, our main comparisons focused primarily on Static Molecular and RNA+GRU. In the revised manuscript, we have expanded Section 2 (Related Work) to discuss Recurrent Kalman Networks (RKNs) and related sequence representation learning paradigms, and we have substantially broadened our empirical benchmark in Appendix E (Table 7) and Appendix H (Table 9) to evaluate RNA+RKN alongside a time-aware Transformer and two learned-gain neural filtering baselines under the exact same nested-CV protocol.
Core innovation in combining neural encoding with explicit Kalman filtering, and distinction from RKNs: RKN (Becker et al., ICML 2019) is indeed a strong and representative neural state-space model that combines deep observation encoders with factorized latent Kalman updates. While sharing the high-level spirit of marrying neural networks with state-space estimation, our core innovation lies in how we couple neural representation learning with explicit continuous-discrete Kalman covariance propagation specifically for irregular clinical survival prediction:
Neural clinical encoding with explicit time-aware covariance propagation: We use a neural observation encoder to map heterogeneous, partially observed clinical visits into a compact latent state space, where process uncertainty grows explicitly with the elapsed inter-visit interval rather than relying on locally linear transition bases learned for dense sequences as in RKN.
Sample-efficient inductive bias for sparse clinical trajectories: By delegating nonlinear feature extraction to the neural encoder while governing temporal state updates through analytical covariance recursion, our model achieves high sample efficiency on sparse clinical histories (median 4 visits per patient).
Empirical comparisons against RKN and additional sequence models: Across five matched nested-CV repeats under identical clinical inputs, observation masks, and late-fusion rules:
Comparison with RNA+RKN (Appendix E, Table 7): RNA+CovarianceKalman achieves a mean pooled OOF C-index of 0.7191, outperforming the time-aware RKN adaptation (0.6901) across all five repeats with a mean paired improvement of +0.0290.
Comparison with Time-Aware Transformer and learned-gain neural filters (Appendix E & Appendix H): RNA+CovarianceKalman also consistently outperforms RNA+Transformer (0.7160 vs. 0.6990, +0.0169 mean paired gain, winning all 5 repeats, Table 9) as well as learned constant-gain (0.7079, +0.0112 gain) and learned time-dependent-gain (0.7035, +0.0156 gain) variants (Table 7).