- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes RIDER-MoE, a reliability-aware mixture-of-experts framework for robust multimodal sentiment analysis. It employs five PID-inspired experts corresponding to modality uniqueness, redundancy, and synergy, and introduces masked-view Disentangled Interaction Regularization (DIR) to encourage distinct expert behaviors. A reliability-aware router combines unimodal predictive uncertainty, modality importance, and cross-modal consensus to adapt expert weights to individual samples. Experiments on CMU-MOSI, CMU-MOSEI, and CH-SIMS report competitive clean performance and improved aggregate robustness under noise, missing modalities, and cross-modal conflict, supported by component ablations and routing analyses.
Critical strengths
-
The paper addresses a relevant robustness problem by extending adaptive fusion from modality-level weighting to interaction-level routing.
-
The experimental evaluation is relatively comprehensive.
Critical weaknesses
-
The interaction-specific expert roles are not sufficiently established by the proposed objectives and analyses. In Section 3.4, the uniqueness and redundancy objectives primarily enforce output invariance under selected modality removals, while the synergy objective trains the corresponding expert to predict the residual unexplained by the other experts. However, these behaviors do not necessarily imply that the experts capture unique, redundant, and synergistic task-relevant information. In particular, the residual assigned to the Synergy Expert may also reflect prediction errors or insufficient capacity of the other experts rather than genuine joint-modality information. Moreover, all five experts operate on the same fused multimodal representation, without explicit restrictions on the information each expert can access. Although Figures 4–5 and the supplementary analyses demonstrate distinct routing patterns and masked-view behaviors, these diagnostics largely reflect the properties encouraged by the training objectives. I would like to see more direct evidence of the experts' predictive roles, such as evaluating their contributions under controlled modality interactions or comparing their behavior against independently constructed interaction-specific targets.
-
I²MoE [1] already introduces interaction-specific experts with weakly supervised objectives and sample-level reweighting to model unique, redundant, and synergistic multimodal information. Although this work is cited, its methodological relationship with RIDER-MoE is not sufficiently clarified, and it is absent from the experimental comparisons. More recently, QA-MoE [2] explicitly estimates modality reliability to guide expert routing under missing and degraded observations, making it particularly relevant to the proposed reliability-conditioned framework. While the paper includes several strong robustness baselines, including TMDC, the current comparisons do not sufficiently isolate the advantages of combining PID-inspired experts with reliability-aware routing over these closely related alternatives.
Refs:
[1] Jiayi Xin et al. I2MoE: Interpretable Multimodal Interaction-aware Mixture-of-Experts. ICML 2025.
[2] Yitong Zhu et al. QA-MoE: Towards a Continuous Reliability Spectrum with Quality-Aware Mixture of Experts for Robust Multimodal Sentiment Analysis. ACL 2026.
Questions for authors
- How do the authors distinguish genuinely synergistic task-relevant information from the residual prediction errors of the non-synergy experts? In particular, what evidence supports interpreting the residual-fitting objective in Eq. (7) as learning cross-modal synergy rather than compensating for limitations of the other experts?
- Since all five experts receive the same fused multimodal representation, how do the proposed masked-view constraints ensure meaningful interaction-specific specialization? Beyond the output invariance and residual correlation analyses, is there evidence that the experts rely on the intended modality interactions when making predictions?
- How does RIDER-MoE differ methodologically from I²MoE [1], particularly regarding the interaction-specific expert design, weak supervision, and sample-level expert weighting? Which improvements can be specifically attributed to reliability-conditioned routing rather than the interaction-aware MoE architecture itself?
- Please consider extending the experimental comparison to include closely related methods such as I²MoE [1] and QA-MoE [2], where comparable evaluation protocols are available. Although QA-MoE is relatively recent, its close relevance to the proposed reliability-aware routing mechanism makes a comparison or a more detailed discussion particularly valuable.
- I would like to see more targeted experiments that directly evaluate the predictive contributions of the different expert types, such as controlled interaction-specific datasets, comparisons against simpler expert-role assignments, or analyses of expert-specific performance under independently characterized modality interactions.
I would be willing to raise my score if the authors can adequately address these concerns, particularly through clearer methodological differentiation, more comprehensive baseline comparisons, and stronger validation of the expert specialization mechanisms.