- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces a clustering method for high-dimensional data, specifically for cases where the number of features is larger than that of instances. The proposed method first identifies the dependence structure among features based on graph spectral analysis, and then utilizes the identified information for clustering instances. The performance of the proposed method was evaluated using synthetic datasets, demonstrating its robustness against feature graph perturbation. In addition, real biological datasets were analyzed using the proposed method as practical applications.
Critical strengths
The authors address an important problem setting in clustering where the number of features exceeds the number of instances. While the proposed method leveraging feature grouping yields promising results compared to existing baselines in numerical experiments, I have several concerns regarding the current manuscript.
Critical weaknesses
-
The core contribution of the proposed method appears to be a structured Transformer leveraging feature groups. However, the effectiveness of this framework has not been sufficiently evaluated, either theoretically or empirically.
-
Much of the necessary information is missing from the manuscript, such as variable definitions and the baseline methods. The unstructured Transformer should be explained in more detail in Section 4.2, specifically clarifying which part differs from the proposed method.
Questions for authors
-
Why is the permutation of observed variables assumed? It seems unlikely that such a scenario arises in practical applications. Could the authors provide practical examples where such a permutation occurs? In addition, Proposition 1 is rather trivial and may not warrant being designated as a standalone proposition.
-
Theorem 1 appears to cover the scenario where prototype labels are invariant. However, my understanding was that the underlying theory applies to a broader setting, unconstrained by specific feature groupings or transformer-based models. Could the authors clarify the generalizability of Theorem 1 regarding this aspect?
-
How did the proposed method adjust the number of principle components, described in line 140? It provides important information because the adjustment significantly affects to the clustering performance.
-
Could the authors clarify the rationale behind selecting the baseline/comparison methods? It would be valuable to include baselines that apply dimensionality reduction (e.g., PCA, spectral clustering, or UMAP) directly to unstructured Transformer inputs prior to K-means clustering. Such ablation baselines are essential to isolate and demonstrate the effectiveness of feature grouping.
Explanations of important variables are missing from the manuscript.
- Line 110: is covariance for which variables? (I guess it for features.)
- Line 141 and 155: Variable is defined for different meanings.
- Line 202: What is ?
- Line 222: What is ? What were replaced using this parameter? The data generation procedure is not understandable from this context.
- Line 248: What is sparsity level ?
- Line 324: What are the horizontal and vertical axes?