- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the representation degradation problem in deep multi-view clustering, where increasing the encoder depth does not necessarily lead to better clustering performance. To address this issue, the authors develop HRG-MVC, which maintains information propagation through hierarchical residual connections while leveraging cross-view consensus to refine the learned representations. The consensus is estimated at different levels using a Transformer and adaptively incorporated into subsequent layers through a gating mechanism. The ablation studies and depth comparisons demonstrate the effectiveness of residual learning and the complementary role of cross-view guidance.
Critical strengths
1.The combination of hierarchical residual learning and cross-view guidance is interesting and well designed. In particular, incorporating consensus information into subsequent residual stages provides an effective way to enhance information interaction across different views. 2.The method achieves strong clustering performance on several benchmark datasets. The comparison between plain and residual encoders, together with the guidance ablation, provides good empirical support for the proposed framework.
Critical weaknesses
1.The effectiveness of cross-view guidance varies across datasets. Some additional explanation of this behavior would help readers better understand the role of the proposed gating mechanism. 2.While the theoretical complexity is discussed, the practical computational overhead introduced by the Cross-View Transformer and gating modules is not explicitly quantified.
Questions for authors
1.According to Table 4, gated guidance substantially improves performance on Caltech-5V but offers limited benefits on Handwritten. What factors might account for this difference across datasets? 2.A simple analysis of the learned gating values, such as their average magnitude on a representative dataset, would provide further insight into how the mechanism operates. 3.Please provide a brief analysis of the learned gating values, such as their average magnitude on a representative dataset, to illustrate how the model uses cross-view guidance. 4.The practical computational overhead deserves further discussion. Please report the parameter count and training time of HRG-MVC compared with the residual encoder using mean-pooling consensus. 5.The theoretical results in Appendix A provide useful insights into residual learning and cross-view guidance. However, Proposition A.1 relies on a bounded Jacobian assumption, whereas Proposition A.2 considers a scalar gating coefficient. It would be useful to clarify how these assumptions relate to the practical implementation of HRG-MVC.
Response to Reviewer JAJb
Response to Question 1:
Thank you for your comment. The original Table 4 used a narrower hyperparameter search space than the main experiments. We therefore repeated the ablations, independently re-tuning each variant under the same search space and budget, and added UCI-Digit.
Table 1. Ablation of cross-view guidance and gating (%).
Gated guidance improves ACC by 0.36 and 0.20 points over no guidance on Caltech-5V and Handwritten, respectively. The smaller gain on Handwritten likely reflects its near-saturated performance, whereas Caltech-5V may offer greater cross-view complementarity.
Importantly, ungated guidance degrades performance on both datasets, potentially due to indiscriminate injection of redundant or inconsistent information. Feature-wise gating selectively controls cross-view contributions, improving all three metrics. On UCI-Digit, ungated guidance is already beneficial, but gating further improves performance, confirming its effectiveness across different datasets.
Response to Questions 2 and 3:
Thank you for your suggestions. We analyzed the learned gates and relative cross-view correction magnitudes on Caltech-5V and Handwritten using the final model (seed 5, epoch 600), averaged over samples, views, and features.
Table 2. Learned gate statistics and cross-view corrections.
Note: Relative correction norm measures the L2 norm of the gated correction relative to the local representation. SD reflects gate-value dispersion.
The results reveal adaptive, level-dependent cross-view guidance. Gate means remain similar across levels on Caltech-5V but decrease substantially on Handwritten (0.4341 to 0.1997). Meanwhile, relative correction norms decrease markedly at deeper levels on both datasets, suggesting that gating allows stronger relative corrections at earlier stages while preserving deeper representations.
Response to Question 4:
Thank you for your suggestion. We compared HRG-MVC with Residual + Mean, which replaces the Cross-View Transformer with mean pooling while retaining the residual backbone.
Table 3. Computational cost and clustering performance.
The Transformer introduces modest computational overhead, increasing training time by 0.075, 0.034, and 0.068 seconds per epoch while improving ACC by 12.00, 0.65, and 5.51 points, respectively, demonstrating a favorable performance–cost trade-off.
Response to Question 5:
Thank you for your comment. Both propositions establish sufficient theoretical conditions rather than constraints explicitly enforced during training. Proposition A.1 uses a bounded Jacobian assumption to characterize local residual stability. Although this bound is not enforced, additive shortcuts provide a direct information pathway that helps mitigate depth-induced degradation.
Proposition A.2 adopts scalar gating for analytical simplicity, whereas HRG-MVC employs data-dependent feature-wise sigmoid gating, allowing different features to receive different correction strengths. Thus, the propositions explain the motivation behind our design without guaranteeing that their conditions always hold in practice. We will clarify these connections in the revision.