- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors observe that, in multimodal fake news detection, directly performing cross-modal interaction and fusion may propagate noise from individual modalities into the fused representation, thereby impairing the final prediction. To address this issue, they propose an Evidential Multi-view Uncertainty Learning (EMUL) framework that uses uncertainty as a regulatory signal throughout the detection pipeline. Specifically, EMUL consists of three stages: uncertainty-aware multi-view representation learning, which estimates token- and patch-level uncertainty and performs confidence-weighted aggregation to obtain more reliable modality representations; uncertainty-guided semantic alignment, which uses the estimated uncertainty to modulate the alignment between local modality representations and global image-text semantics; and reliability-aware evidential fusion, which jointly considers intra-modal and evidential uncertainty to calibrate and fuse the text, image, and fused views. Compared with a range of representative baselines, EMUL achieves the best performance on Weibo and Weibo-21, while remaining competitive on GossipCop.
Critical strengths
- EMUL provides a coherent three-stage framework for suppressing unreliable intra-modal information before and during multimodal interaction and fusion. Specifically, the framework first performs uncertainty-aware multi-view representation learning to estimate token- and patch-level intra-modal uncertainty and suppress unreliable local units through confidence-weighted aggregation, then applies uncertainty-guided semantic alignment, and finally conducts reliability-aware evidential fusion to produce the final prediction. This design directly targets a limitation identified in prior multimodal fake news detection methods, where encoded local units are often treated as reliable inputs and token-/patch-level noise is insufficiently controlled before cross-modal interaction and decision fusion.
- EMUL demonstrates strong empirical performance across multiple benchmarks, and the ablation studies provide evidence for the usefulness of uncertainty-aware representation learning. The proposed method achieves the best performance on Weibo and Weibo-21 and remains competitive on GossipCop. In addition, removing TCUE consistently degrades performance, while the local-corruption experiments further show that uncertainty-aware representation learning improves robustness under synthetic textual and visual perturbations. These results are consistent with the intended effect of suppressing unreliable local information and suggest that explicitly modeling local reliability before multimodal interaction is a useful design choice that may provide insights for future multimodal learning methods.
Critical weaknesses
1.The motivation regarding the propagation of intra-modal noise could be better substantiated. The paper argues that unreliable tokens or patches within each modality may propagate through cross-modal interaction and fusion and eventually impair the final prediction. This is a reasonable motivation, and the local-corruption experiments provide evidence that explicitly suppressing unreliable local information can improve performance. However, the current analysis does not systematically demonstrate how intra-modal noise is propagated or amplified by existing multimodal fusion methods. In particular, it remains unclear to what extent prior methods are unable to implicitly suppress such noise or uncertainty during end-to-end training. A more systematic analysis of how noisy local information affects representations before and after multimodal interaction, or how representative baselines respond to controlled intra-modal corruption, would better support this central motivation. Otherwise, the corresponding claims about noise propagation or amplification may need to be stated more conservatively.
2.The novelty of the individual components appears relatively modest, with the main contribution lying in their integration into a unified uncertainty-aware framework. TCUE, UGSA, and RAEF are built on established ideas such as variational uncertainty estimation, adversarial semantic alignment, and evidential/Dempster-Shafer fusion. The paper’s main novelty therefore seems to come from consistently propagating intra-modal uncertainty across representation learning, semantic alignment, and decision fusion, rather than from a fundamentally new mechanism in each component.
Questions for authors
I encourage the authors to address some of the following issues in the rebuttal and I would adjust the rating based on the results.
1.The paper motivates EMUL by arguing that intra-modal noise may propagate through cross-modal interaction and fusion and eventually impair the final prediction. Could the authors provide further evidence or analysis showing how such noise affects existing multimodal fusion methods? In particular, to what extent can conventional end-to-end training implicitly suppress unreliable information from individual modalities?
2.The paper does not specify the coefficient values used for the loss terms in the main experiments, such as , , , and . Could the authors clarify the exact values used? Please also clarify whether these coefficients are kept consistent across different datasets or selected separately for each dataset.
3.Could the authors provide experimental results on at least one additional multimodal fake news detection dataset beyond Weibo, Weibo-21, and GossipCop? This would help further assess the generalization of EMUL across different datasets.