- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CW-OPD, a cross-world on-policy distillation method for vision-language models. The authors observe that a student can match the teacher’s answer without relying on the same visual evidence. To address this misalignment, they construct dual-world pairs that share the question and scene but differ in answer-critical evidence through a plan–edit–verify pipeline. CW-OPD performs on-policy distillation in both worlds and additionally distills the teacher’s cross-world belief transition, so that the student learns not only what the teacher predicts but also why its prediction changes. The authors also introduce CWBench with new metrics (CWPA, CWFR), and show improvements on standard benchmarks and CWBench with Qwen3.5 students.
Critical strengths
-
Intriguing motivation with a logically connected method. The motivation is intriguing and the method is logically connected to it. Extensive experiments, including ablations and design choices, support the detailed loss design and can guide future research.
-
Methodological novelty. The idea of distilling the transition from teacher to student, not just each logit, is novel and convincing. Also, the transition loss is well designed and supported by the proposition.
Critical weaknesses
-
Some baselines could be unfair. (1) Some methods, such as Vision-OPD, require a privileged hint in the form of a cropped image, but the paper does not explain how these methods are handled on CWBench training. Vision-OPD is especially important, since the motivational problem (student–teacher misalignment in visual evidence) is closely related to its approach. If the implementation differs from the original paper, this should be clearly explained. (2) Also, the OPD and OPSD results in Table 1 are identical to those in Table 3, where only is used. This implies that these baselines are trained only on (I, q, A), which is half of the data samples, without (I′, q, B). If the other baselines are also trained in this way, the comparison could be unfair, since CW-OPD additionally uses the edited worlds.
-
The asymmetric gain between the two worlds lacks a logical explanation. The transition loss is defined symmetrically on the two worlds, so it should in principle affect the responses in both worlds. However, in Table 3, adding the transition loss improves mainly A Acc (original world), while B Acc (edited world) barely changes. The paper does not explain why the transition supervision benefits only one side. In addition, almost all models, including frontier models, show much higher accuracy on world B than on world A, which suggests that the edited images may be easier, for example due to overly salient edits or the verifier favoring easy pairs. Without explaining this asymmetry, the CWPA gain could also be interpreted as better solving the original questions rather than responding better to evidence changes.
Questions for authors
- Figure 1 averages the results of the Qwen3.5-9B teacher (OPD) and the 4B EMA teacher (OPSD). Could you report them separately? Since the EMA teacher is conditioned on an answer hint, its stronger sensitivity in Figure 1(c) might come from the hint rather than from better visual grounding.