- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes the application of separation enhancement in the context of class-imbalanced semi-supervised learning: The encoder continues to learn representations with consistency from weak to strong, while the independent linear Weak-View Classifier (WVC) only uses weakly enhanced features to train the final classification boundary, and its loss is not backpropagated to the encoder. Reference-Guided Logit Adjustment (RGLA) uses the cosine nearest class mean classifier as a reference, and dynamically updates the logit adjustment strength of the backbone network based on the difference in head category preferences predicted by the two branches. The authors illustrate the effect of reducing the class mean distance on amplifying the boundary displacement caused by prior imbalance using an equal-variance two-class Gaussian model, and provide a comparison of the weak/strong views of the encoder, contraction of the class means, and data balancing control to support this explanation. Competitively good results are reported on four benchmark classes and multiple SSL backbones; the appendix also provides the weak view transfer of ABC, the compatibility of FreeMatch/SoftMatch, and the analysis of the controller. The theory here is to simplify the mechanism analysis, and not to provide a complete guarantee for the entire pseudo-label and adjustment loss training process.
Critical strengths
- The core enhancement principle has strong control experiments rather than relying solely on final accuracy. Table 6 only changes the view used for the unlabeled classification loss on the same encoder, and the weak view increases by 1.1–4.4 percentage points in six settings. Table 1's synthetic contraction maintains the relative positions within the pseudo-label group, and the tail class recall decreases as the contraction increases; under the balanced condition, the weak/strong difference basically disappears, and the additional experiments of ABC retain the original weight balancing mechanism. In summary, these evidences effectively support the separation of the enhancement role, rather than mixing all benefits in a new system.
- The method is lightweight and has practical usability on multiple distribution conditions and backbone networks. WVC does not modify the representation learning objective of the encoder, and RGLA does not require the actual proportion of unlabeled classes; results for matching, mismatching, and reverse distribution settings, as well as on four types of datasets, cover the most important usage scenarios of the method. The gap with the strong baseline is small, which cannot be simply explained as a significant victory, but combined with the fixed τ, prototype sample size, control parameters, and running cost checks in the appendix, the competitiveness and ease of integration have credible support.
Critical weaknesses
- The Boundary Amplification Theorem does not directly correspond to the actual used prior-adjusted classifier. Proposition 1 analyzes the unadjusted Bayes boundary with training prior, while WVC adds log πall to the training loss and removes this bias during testing. According to the loss in this paper, the unbiased test logit boundary is b = (σ²/d)[log(p_h/p_t) - log(a_h/a_t)]. When a = p, this prior shift disappears. Therefore, the weak view advantage of the actual WVC still requires residual prior error, pseudo-label errors, finite samples, or variance changes, etc. to connect; the existing proposition itself cannot complete this step. This problem limitation mechanism explains the completeness of the interpretation, but does not negate the existing weak/strong contrast results. (Pages 4, 6–7, Equations 5–7, Proposition 1.)
- The sample number weights of the combined prior and the written optimization objective may not be consistent. Equation 5 constructs πall = (Nπ + Mqback) / (N + M) based on the dataset size N and M, but Equations 6 and 7 respectively calculate the mean based on the labeled and unlabeled minibatch sizes, and then add them equally. If each source is uniformly sampled and indeed optimized according to this objective, the corresponding category mixing weights should be determined by the relative coefficients of the two losses; in the case of equal weights, it is (π + qback) / 2, rather than N:M. When the two distributions match, the difference is not apparent, but when they do not match, it may change the adjustment direction and size. It is necessary to explain the loss/sampling weights in the implementation, or to position Equation 5 as an empirical prior selection rather than a natural statistical correction derived from Equations 6–7. (Page 4, Equations 5–7; Page 5, Equation 10.)
Questions for authors
- Are there any unrecorded N:M loss weights, non-uniform source sampling, or other compensations that make Equation 5 consistent with Equations 6–7? If not, how would constructing a prior based on the effective loss weights affect the weak/strong view gap and the final accuracy in a mismatched setting? This will determine whether the second question is merely a statement omission or a real method choice.
- Please explain how Proposition 1 covers the test boundaries after using logit adjustment. In the existing experiments, which residual imbalance or pseudo-label bias makes the displacement term still exist? Provide corresponding limiting conditions, or separate the "adjusting the prior accuracy/inaccuracy" scenario in the existing fixed encoder setting, which can significantly strengthen the mechanism conclusion.
more in Weaknesses