- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies multi-labeled complementary label learning, where training samples are provided with labels known to be absent rather than positive labels. The authors argue that non-exhaustive complementary labels leave substantial uncertainty regarding the underlying positive-label set, while purely negative supervision admits a degenerate all-zero prediction solution. To supplement the missing positive supervision, the paper proposes CoDi, a CLIP-based distillation framework that combines complementary-label supervision with positive semantic evidence extracted from a frozen CLIP teacher. CoDi constructs positive evidence using global views, random local views, and EMA-student-guided class-aware views. These CLIP-based predictions are class-wise calibrated and fused with EMA student predictions. The resulting evidence is further filtered through a reliability-aware pseudo-positive learning mechanism that incorporates confidence, cross-view stability, agreement with the EMA student, and thresholds derived in part from observed complementary labels. A pseudo-positive bank temporally smooths accepted pseudo-labels. Experiments are conducted on VOC07, COCO14, NUS-WIDE, and CUB200 under four complementary annotation ratios. CoDi achieves the best reported mAP in 13 of 16 settings.
Critical strengths
- The overall motivation and high-level pipeline are reasonably clear, and Figure 1 provides a useful overview of how CLIP-based positive evidence, complementary labels, and the student interact.
- The combination of reliable negative complementary supervision with VLM-derived positive semantic knowledge is sensible and potentially useful.
- CoDi achieves the highest mAP in 13/16 settings.
Critical weaknesses
- The method is highly complex, but the ablation study does not isolate many of its central design choices.
- Many individual components of CoDi—multi-view CLIP prediction, classifier-guided local crops, EMA teachers, pseudo-label banks, consistency training, and CLIP distillation—are already established techniques. The novelty therefore appears to lie primarily in how these components are adapted and combined with complementary-label constraints rather than in a fundamentally new learning mechanism.
- The experimental protocol uses ground-truth labels on a 20% validation split, despite the paper repeatedly motivating the problem as learning without observed positive labels. These labels are apparently used for model/hyperparameter selection. This weakens the practical claim of positive-label-free learning and raises the question of how much fully annotated validation supervision is needed in practice.
- The experimental comparisons do not sufficiently establish novelty or superiority over the closest prior work. The paper itself identifies CCD (Kim & Shim, 2025) as an annotation-free multi-label CLIP distillation method that addresses prediction bias and view sensitivity through classifier-guided local views and calibrated distillation. This appears particularly close to CoDi’s use of global/local/class-aware views, classifier-guided crops, calibration, and student distillation.
Questions for authors
- There is a notation inconsistency around Eq. (13): the text states that student predictions on a strong view are aligned with EMA predictions on a weak view, while the sentence immediately after the equation states that predictions on x_i use the weak view.
- Why is CCD not included as a baseline? Given that CCD already uses classifier-guided local views and calibrated CLIP distillation for annotation-free multi-label learning, what are the quantitative gains of CoDi specifically from incorporating complementary-label constraints?
- Why are recent MLCLL methods such as ComRank and the 2026 complementary-label methods discussed in Related Work but omitted from the experimental comparison? Please compare against the strongest current MLCLL baselines.
- The paper states that 20% of each original training set is reserved for validation and that ground-truth labels are used for validation. How many fully annotated positive labels are therefore required to deploy CoDi? Can the method and all hyperparameters be selected without access to exhaustive positive-label validation annotations?
- How are VLPL and AEVLP adapted to MLCLL? Both were originally developed for settings with positive-label information. Please specify exactly what supervision and pseudo-label initialization they receive in your implementation.
- Please provide a more complete component ablation.