- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
InfoMind proposes a task-oriented, adaptive multimodal representation learning framework designed to dynamically determine the contribution of different modalities to a final task, particularly when these modalities provide inconsistent evidence. The method first constructs shared and residual representations for non-textual modalities using a text-conditioned diffusion model, while employing an asymmetric information bottleneck and task-conditioned residual dependency regularization to learn compact, task-specific representations. Subsequently, the model feeds the shared context, modality-specific task evidence, and pairwise prediction discrepancies into a latent task-state inference module. Through a single state update, it derives sample-specific modality weights, which are then used to fuse the shared interactive representations with modality-private representations. The model demonstrates strong performance across various tasks, and the roles of its core components are validated through loss ablation, structural ablation of the state inference mechanism, and qualitative analysis.
Critical strengths
-
The approach of using both task-level evidence and prediction discrepancies to guide the weighting of modalities is well-motivated. Rather than equating inter-modal differences directly with modal reliability, InfoMind first maps auxiliary predictions from various modalities into a common task space; it then infers the contribution of each modality by incorporating shared context and pairwise prediction discrepancies. This design is conceptually sound and distinct from simple gating mechanisms that calculate weights based solely on raw features.
-
The experiments cover a diverse range of tasks and include ablation analyses for key components.
Critical weaknesses
-
The originality of the proposed method relative to existing approaches is not sufficiently established. There are clear architectural similarities between InfoMind and DiffuFuse (MM 2025), specifically regarding text-conditioned diffusion-based shared/private decomposition, residual construction, dual-stream fusion, and projection-based redundancy control. While InfoMind introduces task-level evidence, an asymmetric information bottleneck, and latent task-state inference, the current experiments fail to adequately isolate the contributions of these added components. Furthermore, the study does not sufficiently demonstrate that these additions provide a significant, independent advancement over existing diffusion-based fusion architectures. Additionally, the authors should clarify the distinctions between their work and EMOE (CVPR 2025).
-
In Table 1 of InfoMind, the results for EMOE are reported as 46.5% Acc-7 and 0.719 MAE on the CMU-MOSI dataset, and 53.55% Acc-7 and 0.527 MAE on the CMU-MOSEI dataset. However, the original EMOE paper reports different figures for CMU-MOSI: 47.7% Acc-7 and 0.710 MAE for the aligned setting, and 47.8% Acc-7 and 0.697 MAE for the unaligned setting. The results for CMU-MOSEI also do not fully align with those presented in the InfoMind table. The authors should provide a reasonable explanation for these discrepancies. Furthermore, while the original EMOE paper reports ACC and F1 scores on the MIntRec dataset, EMOE is omitted from Table 2 in InfoMind. Given that InfoMind claims to be generalizable to intent recognition tasks, the authors should include this baseline, evaluated under the same experimental settings.
Questions for authors
-
The originality of the proposed method relative to existing approaches is not sufficiently established. There are clear architectural similarities between InfoMind and DiffuFuse (MM 2025), specifically regarding text-conditioned diffusion-based shared/private decomposition, residual construction, dual-stream fusion, and projection-based redundancy control. While InfoMind introduces task-level evidence, an asymmetric information bottleneck, and latent task-state inference, the current experiments fail to adequately isolate the contributions of these added components. Furthermore, the study does not sufficiently demonstrate that these additions provide a significant, independent advancement over existing diffusion-based fusion architectures. Additionally, the authors should clarify the distinctions between their work and EMOE (CVPR 2025).
-
There remains a substantial gap between the core semantic assumptions and the experimental evaluations. Since the actual shared representation is derived from random samples within the conditional diffusion distribution, rather than using the conditional mean directly, there is no guarantee that this representation contains only the shared semantics predictable from the text. Moreover, the paper does not sufficiently account for the impact of sampling randomness on final predictions, nor does it include systematic stress tests for modal conflicts.
-
Regarding baseline comparisons, the numerical values reported for EMOE are inconsistent with those in the original paper, and the MIntRec results for EMOE are omitted from the intent recognition comparison table. Furthermore, variations in feature extraction pipelines make it difficult to fairly assess the validity of the primary results.
-
The baseline comparisons lack coverage of the latest research from 2026; the authors should consider conducting a comprehensive comparison with papers published at top conferences in 2026 (e.g., CVPR 2026, ICML 2026, ICLR 2026).