- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes MRCF for multimodal sentiment analysis under incomplete observations. It estimates sample-specific modality reliability using intramodal quality cues, cross-modal semantic consistency, and complete-observation prediction agreement. The estimated reliability guides cross-modal message passing and adaptive fusion, while a complete-observation anchor provides training-time calibration. Experiments on CMU-MOSI, CMU-MOSEI, and CH-SIMS report competitive results under intra-modal and fixed-modality missingness, supported by component ablations and reliability-related analyses.
Critical strengths
-
The paper addresses a relevant problem by explicitly modeling sample-specific modality reliability under incomplete observations. Incorporating reliability into both source-side message weighting and target-side interaction updates is reasonably motivated and provides a coherent approach to reducing the influence of degraded modalities.
-
The experimental evaluation covers multiple benchmarks and missingness protocols, with generally competitive results.
Critical weaknesses
-
Section 2.3 constructs modality reliability targets from the agreement between incomplete unimodal predictions and the complete-observation prediction. However, agreement with the full-modality prediction does not necessarily indicate the quality or correctness of the underlying modality. In particular, a modality providing correct but conflicting evidence may receive a low reliability score when the complete-observation prediction is incorrect. Cross-modal semantic consistency may introduce a similar bias against informative minority modalities. Although Figure 3 reports positive correlations between estimated reliability and the prediction-agreement proxy, this diagnostic follows the same criterion used for training and therefore does not independently establish actual modality trustworthiness. I would like to see more targeted experiments, such as evaluating reliability against ground-truth prediction errors or independently assessed modality quality, and examining cases where the complete-observation prediction is incorrect.
-
Several closely related approaches are absent, particularly EBMC (CVPR 2026) [1], which explicitly estimates instance-level modality trust and adaptively calibrates multimodal learning, and Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities (IJCAI 2026) [2], which uses complete-modality references and decision-level consistency to suppress unreliable information. These methods are particularly relevant to the central motivation and design of MRCF. Moreover, while the existing ablations demonstrate the benefits of reliability-guided interaction, the directional message-strength analysis largely reflects the behavior explicitly encouraged by the routing formulation, rather than independently establishing that erroneous information propagation is reduced. Comparisons under matched missingness protocols, together with more direct evidence connecting reliability-guided message suppression to prediction improvements, would strengthen the empirical conclusions.
Refs:
[1] Enhance-then-Balance Modality Collaboration for Robust Multimodal Sentiment Analysis, Kang He et al., CVPR 2026.
[2] Controlling Decision Drift in Multimodal Sentiment Analysis with Missing Modalities, Chenglizhao Chen et al., IJCAI 2026.
[3] TMDC: A Two-Stage Modality Denoising and Complementation Framework for Multimodal Sentiment Analysis with Missing and Noisy Modalities, Yan Zhuang et al., AAAI 2026.
Questions for authors
-
Please broaden the comparison with recent relevant methods, particularly EBMC (CVPR 2026) [1] and Controlling Decision Drift (IJCAI 2026) [2], under matched missingness and feature protocols where feasible. Clarifying the methodological differences would also help establish the contribution of MRCF.
-
How does the reliability proxy in Section 2.3 distinguish genuinely reliable modality evidence from agreement with a potentially incorrect complete-observation prediction? Do the existing analyses examine cases where the complete-observation prediction disagrees with the ground-truth sentiment?
-
Is there evidence that the estimated reliability scores correlate with actual unimodal prediction errors or independently assessed input quality, beyond their correlation with the prediction-agreement proxy used during training?
-
Figure 4 shows stronger message routing from higher- to lower-reliability modalities, as encouraged by the proposed interaction formulation. Do the authors have evidence that this routing actually reduces harmful information propagation, rather than merely reproducing the designed weighting behavior?
-
I would like to see more targeted experiments that evaluate the robustness of reliability-guided interaction when reliability estimates are imperfect, such as perturbing the estimated reliability scores, comparing alternative reliability targets, or analyzing samples with misleading cross-modal agreement.
The paper presents a reasonably motivated framework and reports competitive results with extensive supporting analyses. However, my main concerns are that the proposed reliability proxy has not been sufficiently validated against actual modality trustworthiness, and that the experimental comparisons do not adequately cover closely related recent methods. These issues currently limit confidence in the central reliability-modeling claims and the empirical advantages of MRCF. I would be willing to raise my score if the authors can adequately address the concerns above, particularly through stronger independent reliability validation and more comprehensive comparisons with relevant baselines.
Dear reviewers,
As the authors have posted their responses, I would encourage you to actively parcitipate in the dicussion.
Thank you.
Best,
AC