- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes DREAM, a framework for incomplete multimodal sentiment analysis that addresses the limitation of existing methods, which primarily rely on global representations and struggle to distinguish the predictive damage caused by the absence of different local information. The core idea is to compare changes in prediction risk after removing the same amount of content from different locations, thereby learning the task relevance of local evidence at multiple scales. In addition, the paper introduces a cross-modal reading module that uses global summaries as a reference, allowing the model to select between global summaries and local evidence based on the specific content of the receiving modality. Experiments on three benchmarks, MOSI, MOSEI, and CH-SIMS, demonstrate that the proposed method achieves promising performance under both random and structured missingness. Overall, the paper combines learning the importance of local information with cross-modal evidence utilization, offering a valuable approach to incomplete multimodal sentiment analysis.
Critical strengths
-
The research problem is practically meaningful. The paper considers not only the amount of missing modality information but also how the specific missing content affects prediction outcomes differently. This provides a reasonable research motivation and helps advance incomplete multimodal learning beyond modality-level reliability estimation toward the identification and utilization of local evidence.
-
The experimental evaluation is relatively comprehensive. The paper evaluates classification and regression performance on three datasets and further investigates scenarios involving different missing rates, contiguous segment removal, and entire-modality missingness. The experiments also include multiple component ablations and qualitative examples, helping analyze the sources of performance improvements.
-
The experimental results are reasonably convincing. According to the reported results, DREAM achieves strong average performance across all three datasets. On CH-SIMS, compared with MIDAS, it improves binary classification accuracy and F1 by 4.11 and 5.05 percentage points, respectively, while reducing MAE by 12.72%. The ablation studies also show that removing the region-ranking supervision, damage-weighted allocation, or local evidence reading component negatively affects model performance.
Critical weaknesses
-
Combinatorial novelty. The paper proposes DREAM, whose core contribution is to learn the task relevance of multi-scale local evidence through paired deletion under an equal budget, and to combine this with cross-modal compatibility for receiver-modality-conditioned local evidence reading. However, its core components are related to existing ideas in deletion-based perturbation importance assessment, multi-scale evidence modeling, and adaptive cross-modal fusion. Thus, the overall novelty lies more in combining existing techniques than in introducing an entirely new methodological paradigm.
-
The independent contribution of the core method needs further clarification. The paper uses prediction damage caused by deleting local regions to learn evidence value, but this supervision signal itself depends on model prediction risk and ground-truth labels. Although the ablation studies validate the effectiveness of the relevant components, the current experiments do not fully clarify how much of the performance gain comes from damage-guided local evidence learning, as opposed to additional training supervision and architectural design.
-
Matching deletion lengths may not fully control for differences between regions. The paper controls the amount of content removed from different regions by matching deletion lengths, but regions of equal length may differ in semantic completeness, temporal span, and information density. For example, deleting a complete emotional phrase may naturally have a different impact from deleting the same number of ordinary words. Therefore, although the experiments demonstrate that deletion at different positions has different effects, further analysis is needed to distinguish whether the gains arise from learning local task relevance or from distributional differences introduced by the particular deletion strategy.
Questions for authors
-
How would the performance change if other local importance estimation methods were used in place of deletion-damage-based region-ranking supervision, such as gradient-based or perturbation-based importance scores? This would help further establish the independent contribution of the core design.
-
Compared with major baselines such as MIDAS, how much additional training time, computational cost, and inference latency does DREAM incur? Does computing deletion-induced damage require multiple additional forward passes for each training sample?
-
Have the authors conducted statistical significance tests for metrics with relatively small improvements? Are the performance advantages observed across three random seeds statistically reliable?
Dear reviewers,
As the authors have posted their responses, I would encourage you to actively parcitipate in the dicussion.
Thank you.
Best,
AC