- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies the problem of how to construct task dependent risks while aligning them into a same representation space to help fusion. And they proposed a fusion method for multimodal ICU outcome prediction. The core idea is that fusion benefits from task-adaptive representations rather than enforcing an identical representation across different tasks. Specifically, the approach integrates two main components: Gated Residual Modality Alignment (GRMA), which generates alignment-aware multimodal representations, and Validation-Controlled Risk Construction (VCRC), which applies development-data risk construction to each individual task. Consequently, the framework accommodates distinct execution paths for different clinical endpoints, avoiding an uniform pathway that may also introduce task-irrelevant signals.
Critical strengths
- Adaptive fusion is an important problem for multimodal clinical outcome prediction.
- It is useful to guide representations by specific tasks, allowing for flexible clinical evidence, risks, and configurations tailored to different endpoints, thereby enhancing prediction adaptability.
Critical weaknesses
-
Originality: The authors tried to clarify their main contributions, which however are still not clear to me.
-
Presentation: The paper is hard to read in general.
- Section 1 advocates that the paper is addressing system-level questions, and the concepts like "endpoint", "executable configuration", etc. are used. It is important to include sufficient background to provide the context to improve readability.
- Section 2 is hard to read. Better to provide an overview of the different components and the rationale behind the design first before providing details in different subsections.
- Section 2.2 The key rationale of using GRMA is not clearly presented (even though that is not the key contribution of the paper). ada_alignmoe_v2 is suddenly introduced without much explanation.
- Section 2.3 refers to Table 1 for more details, but the table is not clearly explaining how to read it. Also, many acronyms like OURS_AlignMOE_ExpertStack_v4, 3.0_bal1, are used without too much background information provided.
- The other sections share similar problems.
- Experiments:
- The experiments lack significance tests and standard deviations for the reported statistics, making it difficult to determine whether the performance improvements are statistically meaningful.
- In Table 2, there are some notations highlighting protocol-adopted implementation and simplied protocol-adapted implementation. More explanation is needed. In particular, how to make sure that the performance comparison is fairly conducted.
- In the controlled representation ablation study (Table 3), the performance margins between variants are too small, especially given the lack of standard deviation. It is hard to conclusively identify the major contributor to the improvement.
- The analysis fails to adequately explain why the method performs well for long-stay and readmission predictions while exhibiting varying performance for mortality prediction.
- Computational costs are neither analyzed theoretically nor demonstrated empirically in comparison with baseline methods.
Questions for authors
Please refer to the "Critical Weaknesses" section.