- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HiReT for longitudinal clinical prognosis using EHR data. It combines a visit-day-node hierarchy, typed relational message passing, and hierarchical GRUs. Experiments on MIMIC-IV show improvements in six-class mortality and prolonged length-of-stay prediction, particularly on class-balanced and ordinal metrics.
Critical strengths
The paper addresses a useful clinical prediction problem and reports promising results. The experiments include established baselines, a same-encoder flat control, component ablations, and patient-level bootstrap analysis, which provide some support for the proposed approach.
Critical weaknesses
-
The methodological novelty is limited. MedHMP [1] already explores hierarchical multimodal EHR modeling, while TRANS [2] integrates temporal dependencies and heterogeneous graphs. These closely related methods are missing from the experimental comparisons. Removing Node Interaction reduces Balanced Accuracy from 27.00 to 26.42 and QWK from 43.85 to 43.32 (Table 3). The Typed Node Encoding ablation also removes multiple components simultaneously, making their individual contributions unclear.
-
There are concerning inconsistencies in the reported results. Table 9 reports 94.57% survival recall, whereas Table 17 reports survival specificity of 92.62% for females and 90.58% for males. Under the stated definitions and test split, the overall recall cannot exceed both subgroup values. Table 16 reports the seed-42 HiReT results from Table 8 while labeling the row as a three-seed mean. These discrepancies raise concerns about the reliability of the evaluation.
-
Some implementation details remain unclear. The construction of daily typed nodes does not sufficiently explain how multiple measurements, medications, and reports are aggregated. Baseline tokenization and context-length handling also differ without adequate evidence-coverage details. Furthermore, in Eq. (8), the directly concatenated background and availability terms appear to cancel during masked-softmax normalization under the shared linear DayFuse scorer, making their intended contribution unclear.
[Related Works]
[1] Hierarchical Pretraining on Multimodal Electronic Health Records. Xiaochen Wang, Junyu Luo, Jiaqi Wang, Ziyi Yin, Suhan Cui, Yuan Zhong, Yaqing Wang, and Fenglong Ma. EMNLP 2023.
[2] Predictive Modeling with Temporal Graphical Representation on Electronic Health Records. Jiayuan Chen, Changchang Yin, Yuanlong Wang, and Ping Zhang. IJCAI 2024.
Questions for authors
-
What is the main methodological contribution beyond MedHMP and TRANS? Could the authors provide a closer comparison?
-
How can the survival metrics in Tables 9 and 17 be reconciled? Why does Table 16 report seed-42 HiReT results as a three-seed mean?
-
How are multiple events aggregated into daily typed nodes, and how is comparable evidence coverage ensured across baselines?
-
Does the DayFuse implementation follow Eq. (8)? If so, how do the background and availability terms affect the normalized fusion weights?