- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes Direction-Preserving Anchor Learning (DPAL) for anchor-based multi-view clustering. It revisits the commonly used anchor reconstruction formulation and identifies that, under orthogonal anchors and simplex-constrained assignments, the norm of assignment weights determines the norm of reconstructed samples. Since Euclidean reconstruction depends on both direction and magnitude, the authors argue that assignment learning is affected by reconstruction scale in addition to clustering structure.
To address this issue, the paper proposes to normalize the anchor combination before reconstruction, preserving only the directional information of the representation. The resulting objective admits closed-form alternating optimization based on orthogonal Procrustes updates and normalized correlation-based assignment updates. Experiments on multiple multi-view clustering benchmarks demonstrate improvements over matched Euclidean reconstruction baselines and reduced sensitivity to the number of anchors.
Critical strengths
-
The paper identifies a non-obvious coupling between assignment norm and Euclidean reconstruction when anchors are orthogonal. The decomposition of reconstruction error into scale and angular components provides a useful interpretation of why the proposed objective behaves differently from standard Euclidean reconstruction.
-
The proposed method does not introduce additional regularization coefficients or complicated optimization procedures. The alternating optimization admits closed-form updates, making the method computationally attractive.
Critical weaknesses
1. The motivation relies on a restrictive formulation and its general relevance is unclear.
The main observation depends on two strong assumptions: orthogonal anchors and simplex-constrained assignments. However, many existing anchor-based multi-view clustering methods employ more flexible anchor learning formulations without strict orthogonality constraints or simplex assignment constraints. In these cases, the claimed assignment-norm issue may not exist in the same form.
The paper would be stronger if it could demonstrate that this phenomenon is prevalent in modern anchor-based MVC methods rather than mainly occurring in the specific formulation analyzed.
2. The paper does not sufficiently justify why assignment norm should be removed.
The paper treats assignment norm as an undesirable reconstruction-related factor. However, under simplex-constrained assignments, the norm of an assignment vector also reflects assignment concentration: .
For example, consider two assignments: and . The former indicates that the sample is confidently associated with one anchor, while the latter indicates ambiguity among multiple anchors. Their norms are substantially different: . Therefore, the norm component may encode useful clustering information such as assignment confidence or anchor concentration, rather than merely introducing an undesirable bias.
By removing the assignment norm from the reconstruction objective, DPAL may discard this information. The paper should provide stronger justification that directional information alone is sufficient or demonstrate cases where preserving assignment concentration is harmful for clustering.
Questions for authors
-
How does DPAL perform when the orthogonality constraint on anchors is relaxed? Is the observed advantage preserved for more general anchor learning formulations?
-
Since DPAL normalizes before reconstruction, it effectively changes the reconstruction geometry from Euclidean similarity to angular similarity. Could the authors compare with existing cosine/spherical clustering approaches to clarify whether the improvement comes from the proposed anchor learning mechanism or from adopting angular reconstruction?
-
Many practical pipelines apply L2 normalization to input features before anchor learning. How significant is the assignment norm effect after feature normalization, and does DPAL still provide substantial improvement under commonly used preprocessing protocols?