- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Reliability-aware Cross-sample Enhancement (RCE) for multimodal sentiment analysis under complete, noisy, and missing-modality conditions. RCE combines a vMF-based variational information bottleneck for modality-wise uncertainty estimation, a memory bank for reliability- and label-aware cross-sample enhancement during training, and multilevel fusion of original and enhanced representations. The authors evaluate the framework on sentiment analysis, humor detection, and sarcasm detection benchmarks, report competitive performance under complete and individual degradation settings, and provide ablation and additional analyses in the appendix.
Critical strengths
-
A practically relevant and coherent framework. Modality corruption and missingness are important obstacles to multimodal sentiment analysis. Connecting modality-wise uncertainty estimation, cross-sample enhancement, and adaptive fusion provides a plausible approach to learning useful representations under imperfect observations. This practical motivation is a substantive strength of the work.
-
Promising empirical performance with useful supporting analyses. The reported comparisons cover multiple benchmarks and both complete and individual degradation settings. Component ablations and additional stability and efficiency analyses help assess the framework's practical benefits. These results make the approach worth considering, even though the central robustness and mechanism claims require stronger validation.
Critical weaknesses
-
The correctness and reproducibility of the central mechanism are not sufficiently established. In Equations (10) and (11), the key/value representations appear to be individual pooled vectors. Under standard token-wise attention, a single key produces an attention weight of one, preventing the query from influencing the output through the attention weights. This raises a substantive question about the claimed prompt-dependent and cross-modal interactions. The vMF sampling procedure and the inference pathway after disabling RME are also insufficiently specified. These issues are consequential because the proposed interactions and reliability estimates are central to the paper's contribution. The implementation clarifications in Questions 1-3 could materially change my assessment.
-
The evidence does not sufficiently establish the claimed contribution beyond closely related methods or robustness under simultaneous missingness and corruption. HME already combines cross-sample enhancement with uncertainty-aware fusion, and PML uses vMF concentration for reliability estimation and fusion. Targeted comparisons against HME with a memory bank and label-aware weighting, or a Gaussian VIB with a matched architecture, would help isolate RCE's contribution. TMDC directly addresses missing and noisy modalities and is cited in the manuscript, but no comparison or explanation of incompatible assumptions is provided. Moreover, the central motivation concerns coexistence of missingness and noise, whereas the reported evaluations primarily examine them separately. The fixed-missing evaluations also cover only combinations containing text. These gaps limit the evidence for the specific novelty and robustness claims that determine my recommendation.
Questions for authors
The following are clarification requests about the current method and reported results, rather than suggestions for future work.
-
Attention implementation: What are the exact query, key, and value tensor shapes in Equations (10) and (11)? If the key/value input is a single pooled token, how does the query affect the output? Please specify any omitted residual connections or retained token sequences and clarify which operations implement the claimed cross-modal interactions.
-
vMF sampling and concentration: What is the distribution and sampling procedure for the scalar in Equation (4), and how are its gradients computed? Does the sampler produce the same posterior distribution whose KL is evaluated in Equation (5)? Table 5 uses for CMU-MOSI, while Table 9 reports mean concentrations around 0.7-1.6. For illustration, a genuine vMF distribution with and has mean directional alignment approximately 0.00614 and KL to the uniform distribution approximately 0.00483 nats. Is any additional concentration scaling used before sampling, and how should these values be interpreted in the implemented model?
-
Inference and missing modalities: When RME is disabled at inference, what replaces the neighbor-enhanced representation used during training? How are unavailable modalities handled in the token construction, shared representation, auxiliary losses, and multilevel fusion? Please specify the relevant masking or substitution rules.
-
Reported F1 metric: Equation (31) and its TP/FP/FN definitions describe ordinary binary positive-class F1, although Appendix D.5 calls the metric weighted F1. Which averaging convention is actually used for the table results? Please confirm whether the implementation computes the support-weighted mean of class-specific F1 scores and correct the mathematical definition accordingly.