- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes InfoSculpt, a post-training refinement framework for generalized category discovery (GCD), addressing the imbalance between discriminative and discoverable information in feature representations. It introduces category-level and instance-level conditional mutual information objectives to improve class discrimination and preserve novel-category structure, with Nash bargaining dynamically balancing these objectives. Experiments across seven benchmarks and five GCD methods demonstrate improved recognition performance, achieving an average overall accuracy gain of 2.3 percentage points with modest training overhead and no additional inference cost.
Critical strengths
- The paper identifies information allocation imbalance as a key limitation in GCD and introduces a unified information-theoretic framework with adaptive Nash bargaining. This provides a meaningful perspective on improving both known-class discrimination and novel-category discovery.
- InfoSculpt consistently improves performance across seven benchmarks and five GCD methods. The extensive ablation studies and statistical significance tests further support its effectiveness, while the absence of additional inference overhead strengthens its practical value.
Critical weaknesses
- The proposed category-level and instance-level CMI objectives build upon existing information-theoretic regularization, while Nash-MTL is an established optimization strategy. The authors should better clarify the fundamental novelty beyond combining these techniques.
- Although the paper emphasizes improving novel-category discovery, Tables 1–2 show that New accuracy sometimes decreases after applying InfoSculpt, particularly for stronger baselines such as ProtoGCD and AptGCD. These inconsistencies raise concerns about the effectiveness and reliability of the proposed information-balancing mechanism across different methods.
Questions for authors
- Clarify the fundamental differences between InfoSculpt and existing information-theoretic regularization methods, particularly how the dual-level CMI formulation contributes beyond conventional representation learning objectives and Nash-MTL.
- Explain why InfoSculpt sometimes reduces novel-class accuracy for stronger baselines in Tables 1–2, despite its goal of improving category discovery. Clarify the differences between these results and the consistent improvements reported under the discovery-oriented preference setting in Section 4.2.
2 comments
Follow-up on the Contribution and Preference Settings
Thank you again for your thoughtful comments. We hope our response clarifies InfoSculpt’s contribution and the distinction between the default and discovery-oriented preferences. Your feedback on these explanations would be much appreciated, and we remain available to discuss any outstanding questions.
We thank Reviewer uG38 for the constructive feedback.
Q1. Contribution and positioning
Our contribution is to turn the representation conflict between known-class discrimination and novel-class discovery in GCD into an explicitly controllable information-allocation problem. Spectral analysis reveals over-compression and under-compression in the novel-class representations of the same model, motivating an explicit choice of which variations to compress under which conditions.
The dual-level CMI design addresses these conditions: category-conditioned constraints compress redundant variation within known classes; instance-conditioned constraints suppress augmentation-induced variation in unlabeled samples and, together with the base objective, retain the structure needed for category discovery. Conditional information thus provides a principle for organizing representation optimization under GCD's two supervision conditions.
These constraints share parameters with the base objective, and their gradient directions and scales can conflict. Nash-MTL coordinates them dynamically to address objective domination under fixed weighting, and preference q explicitly controls the discrimination–discovery trade-off. The contribution links representation-imbalance diagnosis, dual conditional constraints, and dynamic coordination into a GCD refinement mechanism. The spectral ablation in Fig. 2, component ablation in Table 3, and multi-task weighting comparison examine these elements.
Q2. Default and discovery-oriented preferences
The default results in Tables 1–2 use q=1, giving equal preferences to the base, category, and instance objectives. The category-level constraint directly promotes known-class compactness; the instance-level constraint supports novel-class discovery through augmentation invariance. On some stronger base methods, this symmetric preference produces a trade-off between higher Old and lower New accuracy.
Section 4.2 and Appendix G, Table 8 use the discovery-oriented preference q⋆=1.75, increasing the preference for the instance objective while task coefficients remain adaptive per batch. This preference is selected once using only Old-class validation data from RLCD/CIFAR-100, then fixed for RLCD, AptGCD, and all seven datasets. New accuracy improves over matched baselines in all 14 combinations, with statistically significant gains in all 13 held-out comparisons.