- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors propose a multimodal representation learning framework combining, Product-of-Experts (PoE) and Quantum Tree Tensor Network (TTN). The method fuses text, audio, and visual representations into a shared 64-dimensional probabilistic latent space, then transforms the shared latent representation using a 16-qubit variational circuit with 75 trainable circuit parameters. The method is evaluated on three multimodal sentiment and emotion recognition benchmarks: CH-SIMS, MOSI, and MELD.
Critical strengths
- The combination of probabilistic fusion, a quantum latent transformation, reconstruction objectives, and a classical skip connection is clearly described.
- This work explicitly compares the TTN with an MLP, removes the skip connection, and replaces PoE with concatenation.
- The experiments address a practically important problem in multimodal representation learning and demonstrate that the architecture can perform inference using subsets of available modalities.
Critical weaknesses
-
The main novelty is the integration of a quantum TTN into a probabilistic multimodal architecture. Based on the ablation table provided this difference is smaller than the reported standard deviation of the full model. Hence the method doesnt convincingly establish that it is meaningfully better than a comparable classical transformation
-
The authors state that their classical replacement uses a 64–1–3 MLP with 71 trainable parameters, an MLP with just one hidden neuron is extremely constrained.
-
QuTA uses nearly twice as many trainable parameters as CmIR on CH-SIMS for a relatively small improvement.
Questions for authors
-
While the paper evaluates missing-modality and input-noise robustness, these experiments are conducted only on the full QuTA architecture. Could the authors provide details on performance of PoE against concatenation-based fusion under identical missing-modality and corruption settings?
-
why do the authors think QuTA uses nearly twice as many trainable parameters as CmIR on CH-SIMS for a relatively small improvement ?
Dear Authors,
Will you provide a rebuttal for your paper? I think you can try to make it better.
Reviewer