- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the challenges of unreliable and uncertain modalities in multimodal affective computing. To address these issues, the authors propose C²UR, a consistency-guided cross-modal uncertainty rectification framework. Specifically, it separately models modality uncertainty and task utility, employs reliability-weighted cross-modal consensus to rectify uncertain representations, and introduces dual-branch evidence fusion to preserve task-relevant information. Experiments across four affective computing tasks demonstrate improved prediction performance and robustness under noisy and missing modality conditions.
Critical strengths
-
Meaningful research problem. The paper challenges the conventional assumption that highly uncertain modalities should always be suppressed, providing an interesting perspective on robust multimodal learning.
-
Comprehensive experimental evaluation. Experiments across four affective computing tasks, together with ablation studies and robustness analyses, demonstrate the effectiveness of the proposed framework.
-
The experiments consider different combinations of noise intensity and missing modality rates, providing evidence of the model's robustness under degraded inputs.
Critical weaknesses
-
Probabilistic representation learning, Product-of-Experts, and uncertainty-aware fusion have been extensively studied. The authors should further clarify the unique contributions of their integration beyond existing multimodal uncertainty learning methods.
-
The framework estimates modality uncertainty using the variance of learned Gaussian representations. However, it remains unclear whether this variance reliably reflects actual modality uncertainty. Further calibration analysis would strengthen this assumption.
-
In Eq. (6), modality removal is simulated by replacing its representation with a zero vector. However, this operation may introduce out-of-distribution representations.
-
The authors should compare training time, inference latency, and memory consumption with existing methods to evaluate the computational efficiency of the proposed framework.
Questions for authors
-
Although the proposed framework separately estimates modality uncertainty and task utility, it remains unclear whether these two quantities are sufficiently independent. The authors should analyze their correlations under different noise levels and investigate whether the learned utility provides additional information beyond uncertainty.
-
Stronger rectification of high-utility modalities may distort their task-relevant information. The authors should investigate how rectification strength affects the preservation of modality-specific features.