- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
To address the problem that a one-shot fusion paradigm tends to result in insufficient multimodal information fusion—namely, one modality suppressing another and leading to suboptimal performance—this paper proposes ReFuse, a recursive fusion framework that iteratively diagnoses information deficiencies in the current fused representation and selectively re-fuses only those modalities that contain task-relevant information not yet captured.
Critical strengths
1、The authors propose a recursive refinement fusion framework, i.e., an iterative "diagnose–select–reject" loop, to address the problems in the one-time fusion paradigm.
2、The authors designed an information sufficiency diagnoser based on conditional mutual information.
3、Experimental results on multiple datasets validate the effectiveness of the proposed method.
Critical weaknesses
1、The authors' statement in the introduction that the one-shot fusion paradigm has only one opportunity to fuse task-relevant information from each modality at the fusion layer is not sufficiently accurate. During training, the model updates its parameters at every batch and every epoch, so there is not merely "one fusion opportunity." The authors' problem definition is not clear enough.
2、The authors repeatedly emphasize that modality suppression during fusion may lead to suboptimal performance. However, they do not report the performance of the prediction when using only a single modality on each task. Could modality suppression stem from insufficient unimodal feature extraction at the outset, thereby resulting in degraded performance? Or is it simply because a certain modality does not contain task-relevant discriminative features, causing the multimodal task to ultimately only select the task-relevant modality?
3、In a one-shot fusion process, the suppressed modality may be alleviated by dynamically adjusting gradients. Can the recursive refinement framework then incorporate a dynamic gradient adjustment strategy? If so, how effective would it be? Moreover, a one-shot fusion process is already likely to introduce a substantial amount of noise. Could adding weak modality features over multiple steps introduce even more noise, causing the integration of noisy information to outweigh the discriminative features of the genuinely weak modality?
4、The code is not available, which compromises reproducibility.
5、The writing could be clearer, and the logical connections between sections could be improved, which makes the paper somewhat difficult to follow.
Questions for authors
All the questions that need to be addressed have been listed in the Weaknesses.