- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SPARK, a method for online discovery of new categories that leverages the existing feature structure within a closed-set classifier. The authors learn multiple "Local Manifold Anchors" for each known category and construct a shared low-dimensional subspace via SVD. This subspace is then used to constrain the initialization of prototypes for new categories, which are subsequently updated in an online fashion. Experiments conducted on seven public datasets demonstrate that this approach achieves competitive performance on some of these datasets.
Critical strengths
-
This paper attempts to directly utilize the existing feature structure of closed-set classifiers for online class discovery, resulting in a relatively simple overall approach.
-
Using local anchors to represent intra-class variations and applying them to initialize new class prototypes is a promising research direction.
-
This paper provides experimental evidence to motivate the use of local manifold anchors. Figure 1 illustrates the feature structure learned through closed-set supervision, while Table 6 compares different sources for constructing the subspace. The results on CUB are encouraging, suggesting that local manifold anchors may provide a more useful structural feature than class prototypes or instance features.
Critical weaknesses
1. The novelty relative to existing methods needs further clarification.
The core idea of this paper is to use structural information from known classes to assist novel category discovery, but related directions have already been explored in AGE (ICLR 2026). Moreover, PHE (NeurIPS 2024) has already used multiple prototypes to represent intra-class diversity, and Assignment-Driven Hash Learning (CVPR 2026) also constructs multiple prototypes for known classes, so the authors should discuss the differences from these methods. Notably, Eq. (16)–(17) is mathematically similar to the prototype subspace projection mechanism in SAFA-SNN (ICLR 2026), as both combine the original feature with its projection onto a subspace defined by known classes. Although the two methods construct their subspaces differently, the authors should discuss this related work and further clarify the differences in their mathematical formulation and technical contributions.
2. The local specialization of multiple anchors is not sufficiently validated. The authors claim that different Local Manifold Anchors capture distinct local semantic variations. However, Eq. (5) requires each sample to align with more than half of the anchors within its class, meaning that the positive anchor sets of different samples must overlap. I am concerned whether this design can effectively encourage meaningful local specialization, rather than producing largely overlapping anchor representations. Although Fig. 4 studies the sensitivity to (m), the paper lacks direct evidence that the learned anchors actually capture distinct local semantic patterns.
Questions for authors
1. The paper argues that standard closed-set training already preserves useful semantic structures. However, SPARK introduces additional alignment, diversity, and entropy objectives to learn the Local Manifold Anchors. How do the authors distinguish the structural information inherited from the original closed-set features from the geometry introduced by these additional learning objectives?
2. The paper mainly evaluates the Local Manifold Anchors through downstream accuracy. However, it remains unclear whether different anchors actually capture distinct local semantic patterns, as claimed by the authors. Table 3 shows that the diversity and entropy objectives improve performance when used together, but this does not directly demonstrate that the learned anchors represent different local modes. Could the authors provide a more direct analysis of anchor assignments or the samples associated with different anchors to verify their claimed specialization? At the very least, analyses such as activation visualization or correlation analysis are necessary.
3. Eq. (16)–(17) has a similar mathematical form to the prototype subspace projection and weighted fusion mechanism in SAFA-SNN (ICLR 2026). Although the two methods construct their subspaces differently, could the authors clarify the key technical differences and explain what SPARK contributes beyond changing the source of the projection subspace?