- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses dual-mismatched semi-supervised learning, where unlabeled data exhibit both class imbalance and the presence of unknown classes. The authors propose a hub-spoke latent geometry that encourages uniform separation of known-class prototypes and compact within-class representations. The framework also introduces class-adaptive reweighting to improve minority-class learning and an evidential classifier to identify high-uncertainty samples, which are subsequently guided toward a central hub. The paper provides a theoretical analysis of the low-evidence region around the hub and evaluates the method on five image classification benchmarks. The results show consistent improvements in average classification accuracy over existing SSL, long-tailed SSL, and open-set SSL methods, although the magnitude of improvement varies across datasets and settings.
Critical strengths
-
The paper addresses an important and practical problem in semi-supervised learning. Considering class distribution mismatch and unknown-class contamination simultaneously is well motivated, as both can arise in real-world unlabeled datasets.
-
The proposed hub-spoke geometry provides an intuitive way to organize known-class representations while separating potentially unknown samples.
-
The experimental evaluation covers five datasets and includes comparisons with a broad range of SSL, long-tailed SSL, and open-set SSL methods. The authors also provide ablation studies and analyses of minority-class accuracy and pseudo-label quality.
-
The proposed method achieves the highest average classification accuracy across the evaluated settings, with meaningful improvements in some challenging low-label scenarios.
Critical weaknesses
-
The methodological novelty is somewhat limited. The proposed framework combines several established techniques, including prototype-based representation regularization, class-adaptive reweighting, and evidential uncertainty estimation. The overall approach appears somewhat ad hoc, and the paper does not sufficiently establish a unified principle explaining why these particular components should work together to address dual mismatch. The ablation studies demonstrate incremental improvements but do not establish whether the proposed integration offers advantages over simpler combinations of existing methods.
-
The design of the hub-spoke geometry lacks sufficient justification. In particular, it is unclear why samples from potentially diverse unknown classes should be encouraged to cluster around a single central hub. The theoretical analysis establishes a low-evidence region under certain assumptions, but does not explain why this geometry is optimal or particularly effective for handling unknown classes.
-
The unknown-class identification strategy may conflict with the objective of improving minority-class representations. The method selects the most uncertain unlabeled samples as unknown-class candidates. However, minority-class samples may also exhibit high uncertainty due to limited representation during training. Incorrectly pulling these samples toward the hub could reinforce class imbalance. The paper does not sufficiently examine this potential failure mode.
Questions for authors
How does the method distinguish unknown-class samples from difficult known-class samples, especially those belonging to minority classes? Can the authors report unknown-class detection precision and recall, along with false rejection rates for majority and minority classes?
Can the authors provide stronger comparisons with closely related prototype-based SSL methods, including the simplex-based structural approach cited in the paper?
5 comments
Dear Reviewer ee6d,
Thanks for your time and effort in reviewing this paper. Your comments are valuable to improve the quality of this paper. As the author-reviewer discussion period ends in 48 hours, we kindly request that you review the rebuttal and confirm whether your concerns have been addressed. Thanks a lot.
Regards from the authors.
Dear Reviewer ee6d,
Thanks for your time and effort in reviewing this paper. Your comments are valuable to improve the quality of this paper. As the author-reviewer discussion period ends in 24 hours, we kindly request that you review the rebuttal and confirm whether your concerns have been addressed. Thanks a lot.
Regards from the authors.
We appreciate the reviewer's insightful comments and respond to each point below.
Limited novelty (W1)
Our contribution lies in the unified hub-spoke geometry, which jointly organizes known and unknown classes in a shared latent space. We first enforce uniformly spread spokes to maximize inter-class discriminability. Then, exploiting the hub's separation from the spokes, we construct a low-evidence hub region that further separates known from unknown samples. Unlike methods that separately apply prototype-based learning to known classes and uncertainty filtering to unknown classes, our approach couples both through a single geometry.
Why cluster diverse unknown classes to a single hub (W2)
Our goal is to separate unknown classes from known classes, rather than distinguish unknown classes from each other. From this perspective, pulling high-uncertainty unknown samples toward the hub is a natural design. The hub, defined as the mean of all known-class prototypes, is not associated with any known class and lies away from the known-class prototypes. By encouraging unknown samples to cluster around the hub, our method simultaneously separates known and unknown samples in two complementary spaces: in latent space, unknown samples are drawn toward the hub, away from the known-class spokes; in uncertainty space, the hub-centered low-evidence region distinguishes unknown samples from the high-evidence known samples. This allows diverse unknown classes to share a common representation region without requiring discrimination among them. As shown in Fig. 2d, guiding identified unknown samples toward the hub yields a clearer separation between known and unknown uncertainty distributions, validating this desgin.
Conflict with minority-class learning (W3)
To mitigate this risk, we set k to a small value (10% of the batch) and select only the high-uncertainty unknown-class samples, rather than using uncertainty to filter out all unknown-class samples. This selection reduces the risk of pulling uncertain minority-class samples toward the hub and reinforcing class imbalance. We further mitigate the under-representation of minority classes through (i) the hub-spoke geometry, which promotes high inter-class separation and intra-class compactness, and (ii) pre-training and class-adaptive reweighting (Eq. 9), which amplify gradients for minority classes. These measures increase minority-class accuracy from 33% to 64% (Fig. 4a, lb4), while maintaining a low known-class false-rejection rate of 0.028 on CIFAR-10 (lb25).
Unknown-class detection metrics and false-rejection rates (Q1)
On CIFAR-10 (lb25), unknown-class detection achieves precision 0.7859, recall 0.1503, and F1 0.2523, with an overall known-class false-rejection rate of 0.028 (majority: 0.0279; minority: 0.0280). The high precision (0.7859) and the low false-rejection rate (0.028) confirms that we accurately target high-uncertainty unknown-class samples without sacrificing known-class samples. However, this high precision comes at the cost of recall, as our small k selection strategy focuses on the most uncertain candidates to reduce the risk of misidentifying difficult known-class samples as unknown. By encouraging selected unknown samples to approach the low-evidence hub and suppressing their evidence through Eq. (10), the evidential classifier learns to assign low evidence to other unknown samples as well, even when they are not explicitly selected.
Comparison with prototype-based methods (Q2)
Existing methods use prototypes or geometric anchors for different purposes. Prototypical Contrastive Learning [1] uses cluster-level prototypes and ProtoNCE to learn semantic representations. TRAILER [2] aligns representations with pre-assigned ETF targets, while SAGE [3] uses fixed simplex ETF vectors as a class-agnostic coordinate frame for graph-based structural inference.
Our hub differs: as the mean of all known-class prototypes, it is an information-free, low-evidence anchor far from the spokes, giving unknown classes a dedicated region separated from known classes in two coupled senses. In label space, uniformly spread spokes maximize inter-class separation while the hub stays far from every spoke, so known and unknown decision boundaries never overlap. In uncertainty, the low-evidence hub keeps high-uncertainty unknown samples pulled toward it uncertain without degrading known-class evidence. This dual separation, combining known-class spokes with an unknown-class hub, unifies class-imbalance handling and unknown-class detection in one geometry, which none of the prototype-based methods above achieve.
[1] ICLR’21-Prototypical Contrastive Learning of Unsupervised Representations
[2] CVPR’24-Targeted Representation Alignment for Open-World Semi-Supervised Learning
[3] ICML’26-Beyond Distribution Estimation: Simplex Anchored Structural Inference Towards Universal Semi-Supervised Learning