- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper argues that dense token-level supervision are redundant for OPD in visual. The authors show that supervising only the first decision token can retain most of the gains of full-response OPD. Based on this observation, they propose DoD, which performs rollout-free soft distillation at the first output position. Experiments show comparable or slightly better accuracy than Vision-OPD with substantially lower training cost.
Critical strengths
[+]: This paper identifies a clear and important question about the necessity of full OPD trajectories.
[+]: Provides useful comparisons among full-response, decision-only, description-only, and hard-label supervision. Reports meaningful reductions in training time, GPU requirements, and CPU memory.
[+]: The proposed DOD method is simple, computationally efficient, and easy to reproduce.
[+]: Clear writing.
Critical weaknesses
[-]: I question the real-world applicability of DoD. Tailoring MLLMs exclusively for decision tasks (i.e., select a b c or d) through specialized designs is of marginal significance; furthermore, it may inadvertently degrade the model's broader reasoning and generalization abilities.
[-]: Improvements over Vision-OPD are relatively small and inconsistent across individual benchmarks.
[-]: How can it be guaranteed that the cropped images necessarily contain additional information? The cropping strategy seems to fail in scenarios involving multiple objects or abstract concepts (e.g., color, size).
[-]: DoD is essentially an OPSD method, and its utility relies on the premise that the cropped images can provide extra information to the teacher, and the student can gradually learn to discover that region after OPSD. This raises a concern: for extremely small objects in the original image, forcing the student to discover and perceive that region via OPSD appears overly challenging, even meaningless.
[-]: How is the stability of DoD's output ensured?
[-]: The distinction from recent sparse-token and early-stopping OPD methods should be made more explicit.
Questions for authors
See weaknesses above.
3 comments
Response to Reviewer bQH7 (Part 2/2)
W4: Limitations of Privileged Visual Information
We thank the reviewer for raising this concern. We acknowledge this limitation, as extremely small objects may contain visual details that are difficult or even impossible for the student to perceive from the original image. However, the overall goal of privileged-information distillation is to improve the student's ability to extract and utilize visual details. Importantly, this limitation is shared with Vision-OPD, as DOD adopts the same privileged-information setting. Our primary contribution is to make this distillation process more efficient, rather than addressing the inherent limitations of image cropping.
W5: Output Stability and Potential Collapse
We interpret “output stability” as whether decision-only distillation causes the model to collapse into an option classifier or lose its broader generation capabilities.
DOD does not renormalize the candidate-option probabilities to sum to one. Instead, it preserves their full-vocabulary probabilities and matches the aggregate probability mass of all non-option tokens through a tail bucket. Thus, the objective does not explicitly force all probability mass onto the answer options. Moreover, our experiments demonstrate that DOD outperforms Vision-OPD in five of the six non-MCQ comparisons and on all three visual reasoning benchmarks at both model scales, providing empirical evidence that decision-only distillation does not compromise the model's broader generation and reasoning capabilities.
W6: Distinction from Sparse-Token and Early-Stopping OPD Methods
We thank the reviewer for this comment. First, existing sparse-token and early-stopping OPD methods primarily focus on LLM reasoning, while their applicability to MLLM visual perception remains relatively underexplored. More importantly, although these methods have shown that distilling only a subset of tokens can achieve performance comparable to full-response distillation, they still require generating intermediate reasoning steps (i.e., rollouts) during training. In contrast, our key finding is that, for MLLM visual perception tasks, full-response rollouts can be eliminated entirely while maintaining or even improving performance. This enables DOD to perform rollout-free distillation using only the first decision token, resulting in substantially lower training costs. The elimination of rollouts is the fundamental distinction from prior methods, extending beyond simply reducing the number of supervised tokens.
Have our responses adequately addressed your concerns?
Dear Reviewer bQH7,
We sincerely appreciate your time and effort in reviewing our manuscript. Your constructive feedback has been invaluable in helping us improve the clarity and quality of our work.
We have provided detailed responses to your comments and concerns, and we hope they have adequately addressed your questions. If you find our responses satisfactory, we would greatly appreciate your consideration of adjusting your score accordingly. Should you have any remaining questions or concerns, we would be happy to provide further clarification and engage in additional discussion.
Best regards, Authors
Response to Reviewer bQH7 (Part 1/2)
W1: Generalization Beyond Multiple-Choice Tasks and Preservation of Reasoning Ability
We thank the reviewer for raising this concern. We would like to clarify that the multiple-choice format is required only during training, while DOD does not restrict the model to multiple-choice outputs during inference. To address the concern regarding real-world applicability and potential degradation of broader capabilities, we provide evidence from two perspectives.
1. Generalization to non-MCQ tasks. Our evaluation is not limited to multiple-choice benchmarks. Specifically, 224 of the 845 ZoomBench questions and 2,085 of the 2,612 DYSM questions are non-MCQ questions. We further evaluate DOD on OCRBench, which consists of 1,000 open-ended questions requiring textual answers. The results are summarized below.
The results demonstrate that DOD consistently improves over the base models on all three benchmarks at both model scales, despite being trained exclusively with multiple-choice supervision. These findings indicate that the benefits of DOD are not confined to selecting predefined answer options, but can generalize to open-ended visual perception tasks.
2. Preservation of visual reasoning capabilities.
We further investigate whether decision-only distillation compromises the model's broader reasoning capabilities. Although DOD primarily targets visual perception, stronger perception can also benefit downstream visual reasoning by providing more accurate visual evidence for subsequent inference.
To examine this, we additionally evaluate DOD on three visual reasoning benchmarks: MathVision, LogicVista, and WeMath, using thinking mode.
The results show that DOD consistently improves over the base models across all three visual reasoning benchmarks at both model scales. Notably, DOD-4B achieves a 4.86 percentage-point improvement on WeMath, while DOD-9B improves LogicVista by 2.01 percentage points. In contrast, although Vision-OPD improves visual perception performance, its gains do not consistently translate into better visual reasoning performance, with performance degradation observed on several benchmarks. These results suggest that DOD can effectively translate improvements in visual perception into downstream visual reasoning gains, without compromising the model's reasoning performance.
W2: Performance Gains over Vision-OPD and Training Efficiency
We acknowledge that the overall improvements over Vision-OPD are relatively modest, with some variations across benchmarks. However, DOD achieves notable gains on several benchmarks, including HRBench 8K (+3.50 percentage points) and DYSM (+3.94 percentage points) for 4B, and V* (+6.29 percentage points) for 9B. Moreover, our additional visual reasoning experiments (W1.2) demonstrate more consistent advantages of DOD. More importantly, our primary contribution is achieving comparable or better performance at substantially lower training cost, rather than maximizing accuracy gains.
W3: Clarification of Privileged Visual Information
We thank the reviewer for raising this concern. We would like to clarify that we do not claim cropped images necessarily contain additional semantic information. Rather, following Vision-OPD, we refer to cropped images as privileged visual information, as they can provide the teacher with a clearer, higher-resolution view of certain visual details that may be difficult to perceive in the original image. The goal of this setting is to improve the student's visual perception capabilities by distilling knowledge from a teacher with enhanced access to visual details.