- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+2)
Read review
Paper summary
This paper introduces MLPA, a self-supervised framework for multi-modal EHR with non-random missingness, imbalanced modal tokens and scarce labels. It defines modality washout, where high-token modalities overwhelm sparse ones in cross-modal attention. MLPA adopts frozen unimodal encoders, learnable empty-state tokens, and MBT bottleneck transformer, with a masked latent prediction pre-training objective without negatives or teachers. Evaluated on MIMIC-IV and eICU, MLPA cuts parameters by 42.4% vs MAE and surpasses MUSE+ on in-hospital mortality prediction. MBT balances attention and yields tighter patient representations (lower DBI).
Critical strengths
1.The problem is practically important. Incomplete EHRs, highly imbalanced modality token counts, and limited labels are realistic obstacles in clinical representation learning. The newly formalized modality washout offers a concrete characterization of cross-modal attention bias specific to multi-modal EHR scenarios. 2.The system design is clear and the paper evaluates two ICU datasets with comprehensive representation quality analysis and downstream clinical prediction comparisons against multiple strong baselines.
Critical weaknesses
1.Incomplete ablation studies and limited technical novelty. The proposed MLPA is assembled from existing modules adapted for incomplete EHR, yet the paper lacks component-wise ablation experiments to independently quantify the contribution of MBT bottleneck routing, masked latent prediction and empty-state token. It also does not test simpler bottleneck alternatives (e.g., pooling, fixed latent queries). Without validating the necessity of each individual component, the technical contribution of this work cannot be substantiated, which fundamentally weakens the core claims of the paper. 2.The core claim of modality washout lacks causal validation, and key experimental comparisons are missing. The argument for modality washout relies merely on correlational attention statistics rather than causal intervention tests. Moreover, MLPA shows severe performance degradation under dual-modal missingness on eICU and lacks quantitative comparison against highly related SOTA CRL-MMNAR and simple imputation baselines. These omissions undermine the reliability and generalizability of the empirical evaluation.
Questions for authors
1.The paper proposes three core components: MBT bottleneck routing, masked latent prediction objective, and empty-state token, but lacks component-wise ablation to separate their individual contributions. Please clearly answer: Could you provide full component-wise ablation results to quantify the individual performance gain brought by each module? What performance drop occurs if MBT is replaced with simple pooling or fixed latent queries? 2.The paper’s core claim of modality washout is only supported by attention proportion correlation rather than causal evidence. Please clearly answer: Can you perform intervention experiments by masking the high-token medication modality to verify whether this attention skew directly degrades downstream prediction performance? 3. MLPA suffers severe AUPRC degradation and is outperformed by MUSE+ when two modalities are simultaneously missing on eICU, and comparisons between empty-state token and simple imputation baselines are absent. Please clearly answer: Why does MLPA degrade severely under dual-modality missingness on eICU? Can you report comparisons between empty-state token and simple imputation baselines (zero / mean filling) across diverse missingness patterns? 4. The paper only discusses CRL-MMNAR (EMNLP 2025) qualitatively and omits a matched-parameter contrastive baseline with concatenated modal embeddings. Please clearly answer: Will you add quantitative experimental comparisons against CRL-MMNAR, and also add the contrastive baseline with concatenated modality embeddings under matched parameter counts? 5. There exists an unjustified line break within the paper title, indicating insufficient proofreading before submission. Please fix the improper line break in the title.
3 comments
Thank you for the detailed rebuttal, which almost solved most of my soundness concerns. However, the new results have not eliminated my concerns about technological novelty. Therefore, I have increased my rating from 1 (clear rejection) to 2 (weak rejection).
On the claim of novelty
Thank you for the follow-up and for raising your score. Our previous reply presented the contribution as a new combination of components, which undersells it. We agree that the bottleneck, masked latent prediction and missing-modality tokens each exist, and we do not claim them. We claim three findings about incomplete multi-modal EHR:
Shared-query fusion silently loses most of the shortest stream. Age and sex become poorly decodable, yet headline AUPRC drops by only about 0.01. Latent targets beat contrastive objectives and match or beat raw reconstruction, at lower pre-training cost. Explicit missingness handling adds nothing on top of this objective. With trivial handling, the label-free model is competitive with methods built for missing modalities at full labels. With 1% of the labels it is ahead of them on eICU and phenotyping.
Each finding answers a design question that the component papers leave open for this setting, and each changes what a practitioner would build. (The revised introduction now states them as the contributions) If prior work already establishes any of them, we would be grateful for the reference.
Finally, a brief note on how we understand novelty for a paper of this kind. ICLR’s reviewer guide asks whether a submission contributes new knowledge, counting empirical knowledge and knowledge for practitioners, and notes that this does not require state-of-the-art results. On that reading, the question is less whether each module is new than whether the paper establishes something the community did not know, with evidence strong enough to act on. We believe the three findings above meet that bar. Each is supported by controlled comparisons or interventions, and each changes a concrete design decision for incomplete multi-modal EHR. We hope the paper can be assessed on that basis.
If our arguments are convincing to you, please revise your score. We thank you for your efforts and engagement either way.
The evidence follows below.
Details
- Shared-query fusion (Table E).
With Perceiver-style latent queries, linear probes on the patient representation recover age and sex at AUROC 0.71 / 0.74. With the bottleneck they reach 0.96 / 1.00. ICD and radiology content is retained equally well (0.93 / 0.85 vs 0.94 / 0.85). Restoring age and sex recovers about 40% of the Perceiver’s phenotyping deficit. The Perceiver also leans harder on the densest stream. Removing medications costs it 0.384 mortality AUPRC, against 0.327 for the bottleneck.
The loss appears under one routing and not the other, with matched objective, data and parameters. It is therefore a property of the fusion design. It is distinct from the optimization-level modality imbalance addressed by Gradient-Blending or OGM-GE. In headline metrics the Perceiver trails by only 0.014 / 0.012 AUPRC, so the loss is easy to miss.
- Pre-training targets (Tables A, D).
At matched size, VICReg on the same bottleneck loses 0.038 mortality AUPRC, and SimCLR on concatenated embeddings loses 0.028. Raw reconstruction (MAE) ties on MIMIC-IV mortality. It trails in every seed on eICU (by 0.015–0.020) and phenotyping (by 0.002–0.004). MAE also needs decoders and vocabulary heads that latent prediction does not. Changing decoder or predictor depth moves AUPRC by at most 0.007 on MIMIC-IV.
- Missingness handling and label efficiency (Tables B, C, D).
Five encodings of absent streams are within 0.004 AUPRC on MIMIC-IV: learned empty-state token, zero token, omission, explicit indicator and mean fill. On eICU, appending a presence indicator to Zf adds 0.002 AUPRC on all stays and nothing significant on any missingness subset. Zf therefore already encodes which streams are missing. With this trivial handling, MLPA is ahead of MUSE+ and CRL-MMNAR on MIMIC-IV at full labels, and within 0.011 AUPRC on eICU. On eICU stays with two streams missing, MLPA reaches 0.292 vs 0.280 AUPRC and 0.820 vs 0.754 AUROC against MUSE+. With 1% of the labels, it is ahead of MUSE+ and CRL-MMNAR by 0.024 and 0.044 on eICU, and ahead of MUSE+ in all five label draws. On MIMIC-IV phenotyping the leads are 0.059 and 0.051.
Response to Reviewer ZuUt
Thank you for the detailed questions. We answer each with new experiments; Tables A–E are in the general response.
Q1. Component-wise ablation (Table D, MIMIC-IV; changes in mortality / phenotyping AUPRC vs MLPA).
The gains come from the bottleneck and the latent objective. MLPA is robust to how missingness is encoded.
Q2. Intervening on the medication stream. We removed medications at test time and thinned them to 25% of their tokens (Table E). The Perceiver loses more mortality AUPRC than the MBT in both cases (−0.384 vs −0.327 removed; −0.123 vs −0.096 thinned), while removing codes costs it less (−0.040 vs −0.063). Unconstrained cross-attention therefore leans harder on the dense stream. The Perceiver also loses most age and sex information (AUROC 0.71 / 0.74 vs 0.96 / 1.00 for the MBT), and restoring age and sex recovers about 40% of its phenotyping deficit. The removal and restoration tests are interventions, not correlations. They support washout of the shortest stream and show that it accounts for a measurable part of the routing gap. Attention shares are now descriptive only.
Q3. Two missing modalities, and imputation baselines.
Q4. CRL-MMNAR and a matched contrastive baseline.
Q5. Title. The line break is fixed in the revised PDF.
On novelty. Each component has precedents. The combination, as a label-free objective for incomplete multi-modal EHR, is new to our knowledge. The new experiments show what each part contributes: the bottleneck and the latent targets carry measurable gains, and the empty-state token is a convenience. Together they give a label-free representation that is ahead of both supervised baselines on MIMIC-IV at full labels, 0.011 AUPRC behind MUSE+ on eICU, and ahead of both with 1–10% of the labels on eICU and phenotyping (Table B). Our reply to Reviewer qqdC expands on this.
We hope this resolves your concerns about the ablations, the washout evidence and the baselines. If it does, we would be grateful if you reconsidered your score.