- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies weak-to-strong on-policy distillation for vision-language models. W2S-PG constructs supervision by applying softmax to the squared probability differences of one weak teacher under two answer-preserving visual augmentations, then distills this target on student-generated trajectories. AS3 selects between teacher-derived supervision and self-training at each token using confidence scores. The main contributions are the perception-gap target and adaptive supervision selection. Evaluation covers four teacher–student pairs, six perception settings, component ablations, and seven additional benchmarks after training on a separate dataset.
Critical strengths
The substantial reported gains across models and tasks are the main strength. For example, the 4B student improves by 13.5 points on VStar and 19.1 points on ZoomBench, with improvements reported across all four teacher–student pairs. This breadth gives the empirical finding potential significance beyond an isolated model or benchmark and constitutes the main positive evidence for acceptance.
Critical weaknesses
Weakness 1: Core inconsistencies between the equations, experimental statistics, and claimed mechanism.
Equation (2) bounds teacher-derived confidence by e/(V-1+e), while student confidence is at least 1/V, where V is the vocabulary size. Equation (4) therefore selects student supervision with probability greater than 1/e (approximately 36.8%). Yet Fig. 5's stored PDF polyline contains at least eight batch means below 20% in the first 100 steps. Using Table 5's batch size of 128 and Algorithm 1's tokenwise sampling, for equally weighted averages over at least 128 valid gates, with gate-independent masking and fresh independent draws each step, Hoeffding bounds the single-step probability below 20% by 0.0007355. A union bound over eight-step subsets of all 300 training steps gives at most 1.27e-10, on the order of one in ten billion. Under these conditions, ordinary sampling fluctuations cannot plausibly explain the observed frequency. This raises a question about whether the experiments implement the stated algorithm, not merely how the results were plotted.
Section 2.5 does not establish transfer of visual dependence either. It analyzes the teacher's response to perturbations, but the objective does not match teacher and student responses. A teacher whose probabilities vary linearly with the input can produce an image-independent discrepancy under fixed small perturbations, allowing a student that completely ignores the image to achieve zero distillation loss. Equation (2) is also nearly uniform: its total-variation distance from uniform is at most 3.44e-5 for a vocabulary of 100,000.
Table 3 further undermines the perception-transfer interpretation. Under Algorithm 1's exchangeable view sampling, swapping the views reverses the teacher's log-ratio term without changing the student distribution at a fixed prefix. For the reverse-KL objective in Eq. (3), the teacher-dependent terms therefore cancel in the expected token-level distillation gradient, leaving entropy maximization. Nevertheless, this variant achieves approximately 92% of the squared-difference variant's improvement over the baseline student on ZoomBench. The ablation does not establish that these gains come from perceptual knowledge rather than entropy regularization. Additionally, Table 3 never defines how scalar KL/JSD values become the vocabulary-level supervision targets required by Eq. (2).
Weakness 2: The core designs of both claimed contributions have explicit precedents.
Visual-condition-based supervision combined with reliability selection is already an explicit distillation module in IC-VCO. Its VCDist module (ICML 2026, Sec. 3, Eq. (11)) distills a multi-image visual-contrastive preference distribution into a single-image branch, activating supervision only when the supervising branch supports the correct preference and is more confident. The central idea of obtaining supervision from different visual conditions and filtering it by relative reliability is already implemented there.
AS3's core selection principle also appears as an explicit component of an existing method. TSD-KD's "Direct Distillation based on Uncertainty Gap" (ICLR 2026, Sec. 3.2, Eq. (11)) uses the teacher-student entropy gap to regulate token-level teacher intervention on student-generated trajectories. CrossRectify (Pattern Recognition, 2023, Sec. 4.1, Eq. (8)) selects between self and peer pseudo-labels by comparing maximum class probabilities. SelecTKD's Non-Greedy Spec-k branch (CVPR 2026) already uses clipped teacher/student token-probability ratios and uniform random draws to gate distillation. These are concrete supervision-selection rules, not merely related motivations. I regard the weak-teacher setting, squared-probability target, and randomized loss switching as incremental adaptations of these established principles, rather than two substantial independent methodological innovations.
Questions for authors
Question 1: Equations (2) and (4) imply that the probability of selecting student supervision at each valid token is greater than 1/e (approximately 36.8%), yet Fig. 5 repeatedly shows batch means below 20%. Under the averaging and sampling conditions stated in Weakness 1, the probability bound for this frequency is only 1.27e-10. How do the authors reconcile this statistical inconsistency? Were the reported experiments actually conducted using AS3 as defined in the paper?
Question 2: Under the paper's exchangeable view sampling, the teacher-dependent terms of the log-ratio variant of Eq. (3) cancel in the expected token-level distillation gradient at a fixed student prefix, leaving entropy maximization. Nevertheless, this variant achieves approximately 92% of the squared-difference variant's improvement over the baseline student on ZoomBench. What evidence attributes these gains to the transfer of the weak teacher's perceptual knowledge rather than entropy regularization? How does Table 3 substantiate the claimed mechanism?