- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes DualDistill, a progressive generation-to-discrimination framework for annotation-free multi-label visual recognition. The method aims to transfer the recognition capability of multimodal large language models into efficient discriminative prediction. It introduces Cross-Paradigm Distillation (CPD), which combines generative-to-discriminative supervision with generative learning preservation, and Cross-Token Distillation (CTD), which transfers prompt-aware knowledge from a prompt-side classification token to an image-side token. The resulting image-side classifier performs multi-label prediction without task-prompt encoding or autoregressive decoding. Experiments on three benchmark datasets demonstrate strong recognition performance and substantial inference speedups compared with generative recognition and existing annotation-free approaches.
Critical strengths
-
The paper addresses an important limitation of MLLM-based multi-label recognition, namely the high inference cost of autoregressive generation. The progressive transfer from prompt-aware to image-only discrimination provides a clear and practically meaningful solution.
-
DualDistill achieves substantial improvements over existing annotation-free methods while providing significant inference speedups. The evaluation across different datasets and MLLM backbones, together with ablation studies and visualizations, provides encouraging evidence of the framework's effectiveness.
Critical weaknesses
-
The necessity of the progressive distillation design is not fully established. Although CPD and CTD are individually motivated, their underlying operations largely rely on established techniques, including pseudo-label supervision, generative auxiliary training, and prediction-level knowledge distillation. The current experiments do not sufficiently demonstrate why the proposed progressive structure is preferable to simpler distillation alternatives.
-
The framework relies entirely on labels generated by a frozen teacher MLLM, but the influence of pseudo-label errors, especially missing positive labels, is not sufficiently investigated. It remains unclear how robust the proposed approach is to different levels of teacher quality.
-
The reported inference speedups are promising, but much of the efficiency advantage comes from replacing autoregressive generation with direct classification. Stronger comparisons with simpler discriminative adaptations would help isolate the contribution of DualDistill itself. Furthermore, the total cost of teacher annotation generation and student training is not fully discussed.
Questions for authors
-
(Most likely to change my score) Could the authors provide a controlled comparison with simpler knowledge distillation approaches, such as directly distilling the teacher's predictions into an image-only classification token or using a conventional pseudo-label-trained discriminative head? This would help clarify whether the progressive CPD–CTD architecture provides benefits beyond standard discriminative adaptation and knowledge distillation.
-
How sensitive is DualDistill to the quality of teacher-generated annotations? In particular, how does the model handle missing positive labels or incorrect categories in the teacher responses, and would the performance remain stable with a weaker teacher?
-
In Table 3, introducing G2G does not consistently improve the image-side classifier, particularly on Objects365. Could the authors explain why preserving the generative objective benefits the prompt-side pathway more consistently than the image-side pathway, and whether G2G remains necessary when CTD is applied?
-
The proposed CTD transfers predictions from the prompt-side token to the image-side token using KL divergence. Could the authors clarify why this prediction-level distillation is preferable to feature-level distillation or other alignment strategies? Would the two approaches provide complementary benefits?
Thank you for the rebuttal. Most of my concern is resolved and I will raise my score to 3.