- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Reliability-aware Dual-constraint Information Bottleneck (RDIB) to address missing and noisy modalities in multimodal learning. The framework combines a dual-constraint information bottleneck, unified reliability estimation, and reliability-aware dual-stream fusion to learn robust multimodal representations. Experiments on four datasets demonstrate competitive performance under different modality-missing conditions, supported by ablation studies, noise robustness evaluations, and complexity analysis.
Critical strengths
1. Well-Motivated Problem Setting. The paper addresses the practical challenges of missing and noisy modalities in multimodal learning, which are highly relevant to real-world applications. The motivation for developing a unified framework to handle both issues is well justified.
2. Clear Theoretical Motivation. The proposed DIB aims to preserve both target-modality information and task-relevant information, supported by corresponding information-theoretic derivations. This provides a clear theoretical motivation for the proposed method.
3. Comprehensive Experimental Evaluation. The authors conduct experiments on datasets covering four different tasks, along with ablation studies, noise robustness evaluations, visualization analyses, and computational complexity comparisons, providing relatively comprehensive evidence of the method's effectiveness.
Critical weaknesses
1. Limited Novelty. The core approach essentially adds target-modality reconstruction supervision to the conventional Variational Information Bottleneck (VIB) framework. Although the paper provides an information-theoretic analysis, the actual optimization objective remains a combination of KL divergence, reconstruction loss, and task loss.
2. Insufficient Evaluation of Noise Robustness. The paper emphasizes its ability to handle both missing and noisy modalities, but the main experiments primarily focus on missing-modality scenarios. Therefore, its robustness against complex real-world noise remains insufficiently validated.
3. Marginal Performance Improvements on Some Datasets. The performance gains on certain datasets are relatively limited. For example, on MOSEI, RDIB improves the average accuracy over HME by only 0.2 percentage points (78.1 vs. 77.9), while achieving exactly the same average F1 score (76.9).
4. Limited and Outdated Baseline Comparisons. The paper compares against a relatively small set of baselines, many of which are outdated. Several recent competitive methods are not included, making the claim of achieving state-of-the-art performance less convincing.
Questions for authors
1. Novelty: What is the key methodological difference between the proposed DIB and a conventional VIB framework augmented with target-modality reconstruction? Could the authors clarify which aspects constitute the main methodological innovations of this work?
2. Noise Robustness: Although the paper claims robustness to both missing and noisy modalities, the experiments primarily focus on missing modalities. What evidence supports the effectiveness of RDIB under more complex and realistic noise conditions?
3. Marginal Improvements: On the MOSEI dataset, RDIB improves the average accuracy over HME by only 0.2 percentage points, while achieving an identical average F1 score. Are these improvements statistically significant across multiple runs?
4 comments
Response to Reviewer 1Emp - Part 2
W4. Comparison with Latest Baselines
A: Thank you for the suggestion. In the main paper, we selected representative baselines covering widely adopted methods, including recent methods published in 2026. To further strengthen the comparison, we have added recent competitive methods, including CyIN (NeurIPS 2025), EBMC (CVPR 2026), TMDC (AAAI 2026), and MIDAS (TPAMI 2026) on MOSEI, as well as TMDC and MIDAS on D-Vlog and LMVD. As shown below, our method remains highly competitive in average performance. The complete results are provided in the appendix of the revised manuscript.
| Datasets | Models | Venue | Acc2 | F1 |
|---|---|---|---|---|
| MOSEI | CyIn | NeurIPS 2025 | 75.3 | 74.8 |
| ---- | EBMC | CVPR 2026 | 74.6 | 74.1 |
| ---- | TMDC | AAAI 2026 | 77.4 | 77.1 |
| ---- | MIDAS | TPAMI 2026 | 76.2 | 74.4 |
| ---- | Ours | — | 78.1 | 76.9 |
Q3 and W3. Statistical Reliability of Improvements
A: First, we would like to clarify that all RDIB (Ours) results reported in the manuscript are averaged over five independent runs with different seeds. To further assess the reliability and stability of our method, we additionally report the standard deviations in some settings across these five runs, together with those of the reproduced baselines. Some baseline results on MOSEI and Food-101 are directly adopted from their original publications (as marked in the manuscript).
| Model | MOSEI Acc2 (MR = 0.7) | MOSEI F1 (MR = 0.7) | D-Vlog F1 (Both) | LMVD F1 (Both) |
|---|---|---|---|---|
| HME | 72.4 | 69.2 | 73.28 ± 1.38 | 72.39 ± 2.86 |
| TMDC | 71.1 ± 1.22 | 70.4 ± 0.99 | 72.06 ± 0.95 | 70.09 ± 1.13 |
| MIDAS | 70.1 ± 0.56 | 66.1 ± 0.87 | 73.93 ± 1.43 | 73.34 ± 1.24 |
| RDIB | 72.6 ± 0.73 | 69.1 ± 0.64 | 74.81 ± 0.39 | 75.27 ± 1.56 |
We acknowledge that the improvements on MOSEI and Food-101 are relatively marginal. Nevertheless, the additional results demonstrate the stability of RDIB across different seeds. RDIB achieves more substantial improvements on D-Vlog and LMVD. Together with its competitive performance on MOSEI and Food-101, these results demonstrate the effectiveness and cross-dataset applicability of RDIB across diverse multimodal learning tasks and modality-missing scenarios.
Thank you for the response and the additional Salt-and-Pepper noise and baseline experiments, which partially address my concerns about noise robustness and baseline coverage. However, the response confirms that the DIB objective has the same loss form as a supervised VIB with target-modality reconstruction, the added noise evaluation is still synthetic, and the improvements on MOSEI remain marginal, with TMDC achieving a higher F1 in the new comparison, so I maintain my rating.
Response to Reviewer 1Emp
Thank you for your follow-up and for acknowledging our additional experiments. We would like to further clarify the following points.
-
DIB shares the same loss form as supervised VIB with target-modality reconstruction only when the bottleneck, parameterization, and loss weights are identical. However, they differ in their underlying motivations and learning objectives. DIB explicitly aims to jointly preserve cross-modal and task-relevant information under a shared compression budget. Our theoretical analysis (Section 3.2 and Appendix B.1) characterizes the interplay between these two retention requirements and their optimization trade-offs.
-
We agree that synthetic corruption cannot fully capture complex real-world noise. Nevertheless, our experiments with Gaussian and Salt-and-Pepper noise across different corruption intensities and modality availability patterns provide consistent evidence of RDIB's robustness under the evaluated conditions. We leave broader validation under more realistic and complex noise environments to future work.
-
Our extensive experiments across four datasets, including ablation studies, visual analyses, case studies, and parameter sensitivity analyses, support both our motivation and methodological design beyond a single benchmark gain. As the ICLR reviewer guidelines state, “a lack of state-of-the-art results does not by itself constitute grounds for rejection.” We sincerely hope that our broader empirical evidence will be considered collectively when assessing the contribution of this work.
Thank you again for your careful evaluation and constructive feedback. We will continue refining the method and strengthening its evaluation.
Response to Reviewer 1Emp - Part 1
Q1 and W1. Novelty Beyond Conventional VIB
A: RDIB’s methodological novelty lies in how it connects representation learning, reliability estimation, and multimodal fusion to handle both noisy and missing modalities.
[1] Zhuang Y, Liu M, Bai W, et al. Hyper-modality enhancement for multimodal sentiment analysis with missing modalities[J]. Advances in Neural Information Processing Systems, 2026.
[2] Lin R, He Q, Zeng Y, et al. Affection-guided bottleneck diffusion for missing modality issue in multimodal affective computing[J]. IEEE Transactions on Affective Computing, 2025.
[3] Xiao X, Liu G, Gupta G, et al. Neuro-inspired information-theoretic hierarchical perception for multimodal learning[C]//International Conference on Learning Representations. 2024.
[4] Lin R, He Q, Mai S, et al. Cyin: Cyclic informative latent space for bridging complete and incomplete multimodal learning[J]. Advances in Neural Information Processing Systems, 2026.
Q2 and W2. Robustness Under Realistic Noise
A: In real-world scenarios, noise is often complex and may involve multiple corruption types, making it difficult to comprehensively simulate all possible noise distributions. Since the primary objective of noise-robust multimodal learning is to suppress irrelevant information while preserving task-relevant representations, we initially adopted Gaussian noise as a representative corruption to evaluate model robustness.
To address the concern, we extend our experiments to non-Gaussian corruption (Salt-and-Pepper noise) under both complete and missing-modality settings. We further introduce TMDC, a recent method without an information bottleneck (IB) mechanism, as an additional baseline beyond HME. For fair comparison, all methods are evaluated under identical modality availability patterns and noise levels (0–7).
Due to the stronger feature perturbations introduced by Salt-and-Pepper noise, all methods exhibit noticeable performance degradation, particularly under severe corruption. Nevertheless, RDIB consistently outperforms both HME and TMDC across all noise levels and modality availability patterns. These results further demonstrate RDIB's robustness to non-Gaussian corruption, even under severe noise and missing modalities. The corresponding line plots and further analysis have been included in the Appendix of the revised manuscript.