- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Multimodal Shared-State Dynamics (MSSD), which formulates multimodal fusion as the evolution of a single shared recurrent state. Unlike separate-stream and joint-input architectures, MSSD keeps the source interfaces distinct while all sources update one recurrent state without a modality-specific state dimension. The authors further introduce Dual-Axis Dynamics to jointly model dynamics along the latent feature and temporal memory dimensions. Experimental results show the effectiveness of the proposed method.
Critical strengths
-
The proposed MSSD framework is presented in a relatively clear and organized manner.
-
The paper focuses on an interesting problem.
Critical weaknesses
-
The comparison of the baseline model is outdated and fails to demonstrate the competitiveness of the proposed model compared to the latest methods. Moreover, in the table, MSSD does not outperform the existing dedicated multimodal methods in many indicators. Therefore, the current experiments are insufficient to prove the competitiveness relative to the latest methods.
-
How does MSSD adapt to the changes in the importance of modalities in different samples? Can some experimental verification methods effectively handle these variations?
-
Although the paper discussed the relevant multimodal state-space methods, it did not conduct a direct comparison with these methods under a unified experimental setup. Therefore, it is still unclear whether the proposed approach has an advantage over the existing methods.
-
The impact of model capacity differences on performance gains remains unclear. Moreover, the gains from Dual-Axis dynamics are not consistent across all evaluation metrics.
Questions for authors
Please refer to the weakness section.
2 comments
Thanks for the response. The rebuttal has addressed some of my concerns. However, some issues remain unresolved. For example, regarding Weakness 1, although the authors report evaluating a Coupled Mamba-core adaptation under common feature and training settings, the comparisons still do not adequately demonstrate the proposed method’s competitiveness against recent state-of-the-art approaches. Therefore, I will maintain my current rating.
We appreciate the reviewer's detailed comments. We address the four questions below.
W1/W3. Recent multimodal SSMs
We additionally evaluated a Coupled Mamba-core adaptation under common feature and training settings. On MOSI, MSSD achieves 0.723 ± 0.004 MAE versus 0.752 ± 0.007 for the adaptation. This provides a controlled comparison, although it does not reproduce the original method's complete training recipe.
W2. Dynamic modality importance
MSSD uses input-dependent, source-conditioned write/read interfaces, allowing different modalities to contribute through distinct transformations. This supports adaptive source interactions but does not constitute explicit modality reliability estimation.
W4. Capacity and efficiency
We report parameter counts and inference latency alongside performance. MSSD uses 1.148M non-BERT parameters versus 0.837M for Joint Mamba-3, making the additional capacity and computational cost explicit.
W4. Dual-Axis effectiveness
Dual-Axis combines temporal evolution and latent-axis interactions, with dataset-dependent benefits. Temporal-only performs slightly better on MOSI (0.720 vs. 0.723 MAE), while Full MSSD performs better on CH-SIMS (0.399 vs. 0.400). We have adjusted the discussion accordingly.