- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a pseudo-label selection framework for extremely sparse semi-supervised learning. It combines a fixed confidence floor and per-class top-K selection with weak-strong consistency, prototype supervision, and MMD regularization, and uses MoCo pretraining for representation initialization.
Critical strengths
- The motivation to study unreliable pseudo-label selection under extremely sparse supervision is valuable.
- The class-wise selection constraint provides a simple way to control pseudo-label quantity.
- The training diagnostics provide useful observations of pseudo-label quality and training stability.
Critical weaknesses
- The distinction between confidence collapse and confirmation bias is insufficiently explained, while the methodological novelty appears limited.
- The discussion of prior sparse-label results is inaccurate. Existing methods already evaluate settings with four labels per class, and their original results do not support the claim of severe degradation.
- Comparisons may be unfair because the proposed method uses additional MoCo pretraining, while several baselines are simplified reproductions.
- The reason for reducing the unlabeled pool to 10,000 samples is unclear. The experiments do not distinguish label scarcity from insufficient total training data.
- The main hyperparameters are insufficiently justified or analyzed.
- Evaluation is limited to three datasets, and the method achieves the best performance in only four of nine settings. The legend in Figure 4 also needs better placement.
Questions for authors
- Can the authors clarify the distinction between confidence collapse and confirmation bias, and better justify the methodological novelty?
- Can the authors explain the discrepancy between the reproduced baseline results and those reported in the original papers, and evaluate the baselines with the same MoCo pretraining?
- Can the authors explain the reduced unlabeled pool and verify the observations using larger pools?
- Can the authors specify how the main hyperparameters are selected and provide sensitivity analyses?
- Can the authors extend the evaluation to better establish the performance advantages?