- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
A novel framework named CGIB-RCL is proposed in this paper, which mainly contains Cross-Guided Information Bottleneck and Reliable Contrastive Learning module. In detail, CGIB adaptively integrates remaining modalities to preserve shared information while reducing specific content, whereas RCL models reliability to weight negative pairs. Experiments on five datasets verify its effectiveness in balancing information preservation and relation trust.
Critical strengths
1 The overall framework is well motivated. CGIB and RCL address different but complementary aspects of representation learning within a unified framework.
2 The method combines information bottleneck learning with a probabilistic guidance construction, providing a clear motivation for preserving cross-modal information while suppressing unnecessary content.
3 The mechanism analysis provide useful evidence that corrupted supporting views receive lower guidance weights, false negatives receive lower relation scores, and unreliable samples receive lower reliability scores.
4 The ablation studies examine the contributions of CGIB and RCL, as well as the main factors used in negative-pair weighting.
Critical weaknesses
-
CGIB tries to preserve cross-modal shared information while compressing modality-specific information. However, modality-specific information may also be useful for clustering. How does CGIB avoid losing important discriminative information during compression?
-
When evaluating a supporting modality, the reference representation already contains that modality. Could this affect the reliability of the guidance weights?
Questions for authors
-
Does uncertainty-weighted feature fusion perform better than simple average fusion?
-
Although RCL assigns lower weights to unreliable negative pairs, it remains unclear whether this weighting strategy actually reduces their negative impact on clustering performance.
2 comments
The authors have satisfactorily addressed my concerns. I have therefore raised my score to 4.
Response to Reviewer zzbt
Thank you for your constructive comments. We have clarified the relevant mechanisms and added supporting experiments.
Weakness 1
We agree that modality-specific information may contain useful discriminative cues. CGIB does not explicitly remove such information but balances compression and preservation through regularization. The KL term regulates information retention relative to cross-modal guidance, while Rm encourages feature-level cross-modal associations. DDC and RCL provide additional learning signals for clustering.
Table 2 shows that adding CGIB to DDC improves both ACC and NMI on four datasets, while the full model outperforms DDC on all five. These results support the practical effectiveness of this design, although retaining every useful modality-specific feature is not guaranteed.
Revision: We have clarified these complementary roles in Section 3.5.
Weakness 2
We acknowledge that the reference representation includes the supporting modality being evaluated, potentially introducing self-inclusion bias. However, guidance weights depend on the gap between matched and mismatched similarities computed against the same reference, rather than on matched similarity alone.
Figure 5 shows that corrupted supporting modalities receive lower guidance weights and that adaptive guidance is less affected by corruption than uniform aggregation. These results support the practical reliability of the weighting mechanism, although self-inclusion bias cannot be completely ruled out.
Revision: We have clarified the guidance-weight construction and potential self-inclusion effect in Section 3.3.
Question 1
We compared uncertainty-weighted representation fusion with Average Fusion, which assigns equal weights to all modalities. The full model achieves higher ACC and NMI across all five datasets, supporting the benefit of uncertainty-based fusion.
Revision: We have added the average-fusion ablation in Appendix A.7.
Question 2
RCL reduces the influence of potentially unreliable negative pairs through adaptive weighting. Figure 6 supports this mechanism, while the w/o Negative Weighting ablation in Table 3 confirms its contribution to clustering performance across all five datasets.
Additional Constant Weight and Shuffled Weight controls show that the improvement depends on assigning appropriate weights to individual negative relations rather than simply reducing negative-pair contributions.
Revision: We have added these control experiments in Section 4.4.