- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes d-OPD as a future-aware on-policy distillation approach that aims to transform an AR teacher model into a block diffusion student model. The core observation is that the existing method OPDLM suffers from the target-conditioning mismatch, where the student receives supervision that comes from the AR teacher without any awareness of the subsequent denoised tokens. Upon detailed derivation, the proposed method reveals such a mismatch and proposes an empirical fix that restricts the correction to the joint of the teacher and student top-k candidates on the verifier-correct rollouts. Experiments have been performed on Qwen3 family models with various sizes, showing that the proposed approach improves over OPDLM in terms of accuracy, with moderate training-time speedup.
Critical strengths
-
The paper is well motivated by a key observation on the target-conditioning mismatch between the AR teacher and the block diffusion student.
-
Experiments show that the method improves benchmark scores while also obtaining decent training-time speedup.
Critical weaknesses
-
The paper requires a practical surrogate to the theoretically motivated student state-conditioned posterior. The exact target from Eq.7-10 needs to be empirically transformed using only the completed suffix from a single student rollout. Therefore, the resulting target is not necessarily an unbiased estimate of the exact theoretically derived target.
-
The ablation study does not entirely isolate the effect of the verifier-correct rollout and the future-aware correction. A more controlled study that isolates the effect of these two components would strengthen the paper further.
Questions for authors
Q1. The exact posterior conditions on the student-visible state, while the practical correction scores the completed suffix. Could the authors compare the proposed approach against a variant that uses only the visible future tokens, marginalizing or approximating the likelihood of intervening masked positions?
Q2. Could the authors better isolate the contribution of future-likelihood reweighting from correctness gating, in the ablation study?