- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates incomplete multi-view unsupervised feature selection and identifies a potential inconsistency between feature selection and missing-view completion, where the completion process may rely on features that are ultimately discarded. To address this issue, the authors propose SC-MVFS, a framework that combines exact-budget feature selection with a teacher–student learning mechanism. The student performs missing-view completion using only the selected observed features, while the teacher leverages all available observed features to provide auxiliary supervision. The paper presents theoretical analysis and extensive experiments on real-world and synthetic datasets, demonstrating the effectiveness of the proposed approach and its competitive clustering performance.
Critical strengths
(1)Novelty and Research Significance. The paper identifies a potential inconsistency between feature selection and missing-view completion in existing incomplete multi-view feature selection methods and introduces the principle of Selection–Completion Consistency. This perspective offers a novel and meaningful insight into the problem and provides a new direction for jointly learning feature selection and missing-view completion. (2) Well-Motivated and Coherent Methodology. The proposed framework effectively integrates feature selection, probabilistic representation learning, and missing-view completion through an exact feature budget constraint and a teacher–student learning mechanism. Furthermore, the conditional squared-risk analysis provides a theoretical interpretation of the proposed consistency principle. (3)Comprehensive Experimental Evaluation. The paper evaluates the proposed method against several representative baselines on eight real-world datasets and examines its robustness under varying missing-view ratios and feature budgets. In addition, targeted consistency experiments, ablation studies, and controlled synthetic experiments provide further empirical evidence supporting the effectiveness of the proposed framework and its underlying motivation.
Critical weaknesses
(1)Potential Fairness Concerns in Baseline Evaluation. The paper adopts a unified clustering evaluation protocol. However, for methods such as C2IMUFS and UIMUFSLR, which do not directly produce completed views in the original feature space, mean imputation is employed. This strategy may not fully leverage the structural information learned by these methods, potentially affecting the fairness of the comparisons. Furthermore, the current evaluation does not sufficiently disentangle the contributions of feature selection quality and missing-view completion to the final clustering performance. (2)Lack of a Simpler Selection-Consistent Baseline. The central contribution of the paper lies in the proposed Selection–Completion Consistency principle. However, the current experiments do not sufficiently distinguish the benefits of this principle from those introduced by the additional teacher–student learning mechanism. In particular, the absence of a selection-consistent student-only baseline, without the full-input teacher or distillation losses, makes it difficult to assess the necessity and individual contributions of the additional components in the proposed framework.
Questions for authors
(1)Fairness of Baseline Evaluation. For methods such as C2IMUFS and UIMUFSLR, which do not directly produce completed views in the original feature space, the paper adopts mean imputation. Could the authors further justify this evaluation strategy? Would it be possible to provide additional comparisons under the baselines' original evaluation protocols or with a shared imputation strategy to better assess the fairness of the reported results? (2)Independent Contribution of Selection–Completion Consistency. Could the authors include a selection-consistent student-only baseline that does not rely on a full-input teacher or knowledge distillation losses, while maintaining the same feature budget and comparable model capacity and training settings? Such a comparison would help disentangle the benefits of the proposed Selection–Completion Consistency principle from those introduced by the additional teacher–student learning mechanism. (3) Necessity of Key Loss Components. The current ablation studies primarily investigate posterior matching, masked reconstruction, and additional view masking. Could the authors provide separate ablations for the assignment matching loss and mixture regularization, together with sensitivity analyses of their corresponding loss weights? These experiments would help clarify the individual contributions and necessity of these components within the proposed framework.
We thank the reviewer for the constructive assessment and specific experimental suggestions. We completed the shared-completion comparison, the student-only baseline, and separate assignment/mixture ablations with loss-weight sensitivity analyses. We address each question below.
Q1. Can differences in completion procedures explain the comparison?
We evaluated every selected subset using common observed means and an independent Ridge completer (alpha=1). Ridge uses selected source coordinates, excludes the entire target view and predicts selected target coordinates. We reuse the original Table 1 subsets and five seeds, preserving its masks, native feature counts and clustering settings; both common completers use observed-fitted min-max preprocessing.
SC-MVFS retains the lowest mean NMI rank under both common completers among ten methods: 3.250 with common means and 3.250 with common Ridge, across eight datasets at MR=FR=0.3. The native evaluation has mean NMI rank 1.500. This supports selected-subset quality beyond our own decoder.
Q2. A selection-consistent student-only baseline.
We implemented the requested Student with the same neural architecture, initialization seed, natural observation masks and exact K as its paired Full, removing full-input warm-up, teacher targets, posterior/assignment distillation and mixture. Both Full and Student satisfy the selected-input completion constraint. Full achieves higher mean NMI on six of the eight datasets.
Q3. Separate assignment/mixture ablations and weight sensitivities.
As specified in Appendix A, the weights remain fixed globally rather than being selected separately using evaluation-set results. After incorporating these two additional ablation variants, SC-MVFS still achieves the best average NMI rank among all six variants.
Assignment weight
Mixture weight