- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes UGKA for multimodal learning with missing modalities. It uses an information bottleneck, uncertainty-based fusion, and knowledge retrieval. The main idea is to decide how much to rely on knowledge based on the reliability of the available modality.
The paper is overall not reaching the bar of ICLR venue, and I highly recommend the author to revise further and provide more details in motivation, experiment, proposed method and evaluation. But still, I am happy to give comments
Critical strengths
The motivation makes sense: having more available modalities does not necessarily mean having more reliable information. But the motivation is not a new thing in this domain. Other than that, no specific strength can be found in this paper.
Critical weaknesses
The proposed method does not show a clear advantage. The full model performs worse than simple availability-based weighting on KGM3 and ModDrop on HAR, making the benefit of its added complexity unclear. This is a critical weakness to reject the paper.
Some claims contradict the results. Figure 2’s caption says uncertainty gating performs better at high missing rates, while the reported numbers show otherwise. These inconsistencies make the conclusions harder to trust.
The theory does not fully support the claims. A lower bound on error becoming smaller does not show that the model actually makes fewer mistakes. The reliability of the learned uncertainty estimates is also not demonstrated.
The evaluation is limited. The experiments cover only one real dataset and one synthetic dataset, with mostly basic baselines. Stronger comparisons and a real external-knowledge setting are needed to establish the method’s value. This is a critical weakness to reject the paper.
Questions for authors
The knowledge source needs clarification. It is unclear how sample-specific knowledge is obtained during testing, particularly when all modalities are missing. The gains may mainly come from an extra informative input.
Can author clarify a little more on this point?