- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses how to combine a multimodal teacher and a text-only LLM in on-policy distillation. It argues that direct imitation of the text-only teacher suppresses image-dependent variation and creates token-level conflicts with the multimodal teacher. RouTe therefore uses different roles: it selects visually dependent positions from the student's with-image versus without-image log-probability difference and applies multimodal-teacher distillation there; it selects high-entropy nonvisual positions and reverses the text-only teacher's distillation signal there; and it sets the separation coefficient from batch-level student-teacher log-ratio statistics. Training on Geometry3K is evaluated on MathVerse, MathVision, MathVista, WeMath, and HallusionBench with 3B and 7B Qwen-family students and multimodal teachers. RouTe improves average performance over standard multimodal OPD in all three reported student-teacher configurations.
Critical strengths
Writing is clear. The writing is overall clear and easy to understand.
Idea is straightforward. Use heterogenous teachers as supervision is straightforward in post-training.
Critical weaknesses
Baseline is not strong enough. Tthe base model authors use in their experiments, Qwen2.5-VL. Improvements over these models (even in large margins) cannot guarantee the same improvements on frontier models (e.g., Qwen3.5). The paper ignores the direct comparison with Vision-OPD, which uses Qwen3.5 as the base model.
Should include extra compute. Multi-teacher could bring significant additional burden during training, so it is crucial to at least include how many additional compute their design brings, in comparison to OPSD itself.
Questions for authors
See Weakness. Better do experiments on Qwen3.5 as well to prove me wrong. Will the multi-teacher design benefit Qwen3.5 and some benchmarks like HRBench?