- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Prompt-SSLC for on-the-fly category discovery (OCD). The approach combines Semi-Supervised Sequential Leader Clustering with a Distance-Aware prototype update, dual prompt learning to adapt vision foundation models, and an Open-Set-Aware classifier to route known and potentially novel samples. Experiments on coarse-grained and fine-grained benchmarks show improvements over existing OCD baselines on several metrics.
Critical strengths
1.OCD is a meaningful problem in visual recognition, as models cannot be expected to encounter all possible categories during training.
2.The paper evaluates the method on several coarse- and fine-grained benchmarks, with ablation studies and additional experiments under domain shifts.
3.Initializing known-class prototypes with labeled data and updating them as unlabeled samples arrive is a reasonable design for OCD, as it allows the model to retain information about known classes while discovering new ones online.
Critical weaknesses
1. The motivation behind the three challenges is not sufficiently justified. The authors identify three challenges: prototype drift, static feature bias, and computational latency. I agree that prototype drift is a genuine issue in online clustering. However, I am not fully convinced by the second challenge. DINOv2 is pretrained on large-scale data through self-supervised learning, while novel classes in OCD/GCD are mainly simulated through dataset splits and may have already appeared during pretraining. The authors should clarify whether the claimed base-class bias comes from pretraining or subsequent supervised training, and provide direct experimental evidence. Regarding computational latency, hash-based methods such as SMILE are already designed for efficient online category discovery. The authors should justify the need for prototype-based clustering and clarify whether the complete method actually offers an efficiency advantage.
2. The reliability of OSA is insufficiently validated. OSA relies solely on Maximum Softmax Probability (MSP) to distinguish known and unknown classes, but its reliability in OCD remains unclear. The paper does not clearly explain how the OSA classifier is trained or how its confidence is calibrated. If a novel-class sample is incorrectly assigned to a known class with high confidence, it bypasses SSLC and cannot be discovered. Although ablation studies show improvements, the paper lacks direct analyses of Old/New routing errors, MSP threshold sensitivity, and the impact of incorrect routing on novel category discovery.
3. The novelty of the Dual Prompt design needs further clarification. The Task Prompt and Instance Prompt encode general task information and input-dependent information, respectively, which is similar to the G-Prompt and E-Prompt in DualPrompt (ECCV 2022). Although the authors introduce different training objectives and dynamic prototype-based prompts for OCD, the core novelty compared with DualPrompt should be further clarified.
4. The contribution of partial label masking is not sufficiently isolated. The authors introduce partial label masking, self-supervised contrastive learning, and Task Prompt simultaneously, but the ablation studies do not sufficiently isolate their individual contributions. In particular, it remains unclear whether the improvements come from the modified training objective or Task Prompt itself. More controlled experiments are needed to establish the independent contribution of Task Prompt to novel-class generalization.
Questions for authors
-
Static feature bias. From my perspective, Challenge 2 is not sufficiently justified. As mentioned in my review, given that DINO is pretrained through self-supervised learning on large-scale data, it is unclear why its features would exhibit a bias toward base classes. This claim requires more rigorous experimental evidence. Otherwise, I do not think the paper should make such a strong claim about static feature bias.
-
Computational latency. The authors should provide a more rigorous discussion and comparison of the computational costs of prototype-based clustering and hash-based methods. In particular, how does the proposed method compare with hash-based approaches in terms of inference latency and scalability as the number of discovered categories grows?
-
Reliability of OSA. How reliable is OSA in practice? Compared with the classifier proposed in DebGCD (ICLR 2025), what are the advantages of OSA? Its reliability needs to be supported by more direct experiments, rather than ablation studies alone. It would also be helpful to provide failure cases to illustrate when OSA incorrectly routes novel-class samples to known classes and how such errors affect subsequent category discovery.
-
Partial Label Masking. I believe Partial Label Masking has potential, but I have serious concerns about the current design. The authors divide the training classes into pseudo-old and pseudo-new classes, removing class-level supervision for the latter and replacing it with self-supervised contrastive learning. Although this introduces a new training objective, it may also lead to a potentially substantial trade-off: fewer classes contribute to supervised contrastive learning, which could directly weaken the model's ability to learn discriminative representations across classes. In my experience, reducing the number of classes involved in supervised training can cause a much greater performance drop than simply reducing the number of training images, because the model loses explicit supervision signals for those classes. However, the paper does not clearly specify the class split ratio or splitting strategy, nor does it analyze how this design affects the discriminative ability of known-class representations. How do the authors justify this trade-off, and what evidence supports the effectiveness of this design?
General Response to Area Chair and Reviewers
We thank the Area Chair and Reviewers NuDY, A67D, and wzNu. We respectfully push back on key concerns resolved by our submitted results and stream diagnostics, and scope our next revision.
Addressing Key Concerns
OCD Novelty, Bias, & Paradigms
CLSprototypes (§3.3, Eq. 5; clarifying §4.1/Fig. 2: 4096-d ℓ2 MLP head is offline-only) supply parameter-free Pinst alongside 27,648-param Ptask (within App. A's 55,296 prompt-slot budget), with super-additive OSA + Rotation gains (Table 4).OSA, Warm-Up, Shared τ, & Scaling
Spherical Separation, Protocol, & Latency
Decision to Withdraw
While these results resolve the raised concerns, formal proofs and unified ablations belong in the manuscript rather than discussion comments. We are withdrawing to add:
Thank you again for your feedback.