- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a synergy-aware self-supervised framework (URSyn) for multimodal disentanglement. Concretely, it learns separately accessible factors for all three types: unique factors, redundant factors and synergy factor. Experimental results show the effectiveness of the proposed method.
Critical strengths
- The paper considers the synergy factor which is usually neglected in the methods with a conventional shared-private split.
- Various experiments were conducted to demonstrate the effectiveness of the method.
Critical weaknesses
By stating “URSyn is motivated by two idealized constraints: a redundant factor should be recoverable from every singleton, and a synergy factor should share no information with any singleton.”, it means that only the information that are consistent to all modalities are redundant. This assumption is not always hold in reality.
Questions for authors
-
By stating “URSyn is motivated by two idealized constraints: a redundant factor should be recoverable from every singleton, and a synergy factor should share no information with any singleton.”, it means that only the information that are consistent to all modalities are redundant. How can we verify that these constraints are valid in real applications? Would this method fail if there is no cross-model consistent shared information?
-
How are the distinctions between dividing information into redundant, unique, synergy, and categorizing it as task-related or task-irrelevant? Why can the former improve the performance of downstream tasks?