- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CD-OPLD adds latent supervision to on-policy distillation (OPD) for VLMs in three stages. Stage 1 is a structured SFT cold start with <visual>/<reason>/<final answer> tags. Stage 2 pretrains visual and reasoning projectors with InfoNCE (student layer 20 to teacher layer 28). Stage 3 adds a cosine latent loss to reverse-KL OPD, pairing blocks of the student rollout with blocks of an answer-correct teacher rollout by monotonic dynamic programming. With a Qwen3.5-9B teacher and a 2B student trained on 8K ViRL39K samples, mean best@5 over seven benchmarks rises from 84.35 to 85.86.
Critical strengths
- The alignment problem is real. Student and teacher trajectories differ in length and wording, so their latent states do not line up by position. Monotonic many-to-many block matching handles this reasonably, and Table 2 shows it matching or beating whole-span and same-position matching.
- The setup is controlled and well documented. All methods share data, models and training hyperparameters, and Apps. B to F give full details, so the comparisons are easy to reproduce.
Critical weaknesses
- The gains are too small to separate from noise, and the claim of consistent improvement does not hold. Over cold-start OPD, acc@5 gains are mostly between +0.01 and +1.1. CD-OPLD is worse on ViRL8K (53.35 vs. 53.75) and on CRPE best@5, and it is below CompoDistill on POPE and MME, both of which are near ceiling. Every stage uses one seed, and no variance is reported.
- The closest baselines are missing, and extra signal and compute confound the comparison. OPLD, OPRD, VA-OPD and Decomposed OPD are not compared, and it is unclear whether CompoDistill and LaViT start from the same cold-start checkpoint. CD-OPLD also gets GT-filtered teacher references, five teacher rollouts per sample and a contrastive pretraining stage, with no compute cost reported, so the gain may come from this extra information rather than from latent alignment. The ablations lack visual-only and reasoning-only latent losses and sensitivity to λ and the matching threshold, and the error analysis counts corrections in one direction only.
Questions for authors
- Please report mean ± std over at least 3 seeds, with paired significance tests, for CD-OPLD and cold-start OPD.
- Please compare against OPLD and OPRD, and start CompoDistill and LaViT from the same cold-start checkpoint.
- Could the gain come from the GT-filtered teacher references? How does OPD do with the same references, and what is the extra training cost?
- At the 0.92 threshold, what fraction of rollouts and chunks get a matched block? How sensitive are the results to the threshold and to λ_v and λ_r?
- In the error analysis, how many cases does OPD get right that CD-OPLD gets wrong? How were error categories labeled?