- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Self-Supervised Visual On-Policy Distillation (), a new method for visual on-policy distillation. uses an EMA model based on the student model as the teacher model. The teacher observes the original image, while the student receives an augmented view of the same image, which creates a teacher–student asymmetry in their predictions. The student is trained on its own trajectories generated from the augmented view by minimizing the generalized Jensen–Shannon divergence to the token distribution of the teacher conditioned on the original image (on-policy distillation). The authors conduct experiments exploring the augmentation space to find the best configuration, and derive a best recipe that selects one of four augmentations (including no augmentation). Experimental results show that the 9B model trained with outperforms the 397B-scale model and proprietary models, achieves better performance than the compared methods, and shows strong out-of-distribution generalization.
Critical strengths
-
S1. Strong empirical performance. Across six fine-grained perception benchmarks, the 9B model trained with outperforms the 397B-scale model (Qwen3.5-397B), GPT-5.4, and Gemini-3-Flash. also outperforms methods trained with privileged information and self-rewarding RL methods. On generalization to three math reasoning benchmarks, the 4B model underperforms the compared methods, while the 9B model outperforms them.
-
S2. Simple yet effective method. This paper brings training with augmented views, which is widely used in self-supervised and semi-supervised learning, into visual on-policy distillation, enabling training without privileged information. Although the technical novelty is limited, the method is simple and effective, and thus of high practical value.
Critical weaknesses
-
W1. Inconsistencies in reported results. Several numbers in the experiments are inconsistent: Base model accuracy: 70.58% in L258–259, but 66.5 in Figure 2(a)(b). Composition B at 4B: 77.28 in the left panel of Figure 2(c), but 76.33 in the right panel. Composition A at 4B: 76.94 in the right panel of Figure 2(c), but 75.89 in Figure 2(d). If the latter two pairs are results of the same configuration with different random seeds, accuracy varies by about 1 point across runs. In Figure 2, many conclusions, such as the comparison between composition and the best single augmentation and the effect of stacking weak augmentations, rely on differences smaller than 1 point. Since the number of seeds and the variance are not reported, it is impossible to distinguish whether these differences come from the augmentation configuration or from random variation.
-
W2. Unclear validity of the best recipe. Compositions A and B are introduced without any explanation of how they were selected, and the composition analysis (Figure 2(c)–(e)) is built upon them. Moreover, downscaling with Gaussian noise, which the single-augmentation analysis identifies as the most robust default, is not included in A or B, while mixed resolution, a key component of A and B, appears neither in the single-augmentation analysis nor in Table 5. Therefore, the validity of the best recipe, the conclusion of the analysis, is questionable.
-
W3. Minor weaknesses (not affecting my assessment): The “EMA teacher.” paragraph is duplicated in L457–461. It is not stated whether the student model or the EMA model is used for evaluation. There is no analysis of why improves performance on math reasoning.
Questions for authors
- Q1. Regarding W1, is my understanding of the reported results correct?
9 comments
>>> W2 Compositions A and B are introduced without any explanation of how they were selected, and the composition analysis is built upon them. Downscaling with Gaussian noise, which the single-augmentation analysis identifies as the most robust default, is not included in A or B, while mixed resolution, a key component of A and B, appears neither in the single-augmentation analysis nor in Table 5.
>>> A2 Thank you for raising this concern.
Compositions A and B are introduced without any explanation of how they were selected, and the composition analysis is built upon them.
Our original presentation did not clearly explain the relationship between the augmentation search and Compositions A and B. We defined a search space over augmentation operators, their strengths, and composition strategies. The insights in Figure 2(c)–(e), including the benefit of exclusive composition and the effect of stacking weak augmentations, emerged during this search and guided its subsequent refinement. This process ultimately yielded Compositions A and B. Thus, the composition analysis documents the findings that led to these recipes, rather than experiments built around predefined recipes. We also note that the search process use the training set itself as a validation set to select augmentation recipe and report the performance on the evaluated benchmarks. We will clarify this search procedure and its progression in Section 4.3.
Downscaling with Gaussian noise, which the single-augmentation analysis identifies as the most robust default, is not included in A or B, while mixed resolution, a key component of A and B, appears neither in the single-augmentation analysis nor in Table 5.
When updating the original figure, we inadvertently omitted the additional single augmentations explored later in the research, including mixed resolution, which informed the final compositions. The updated figure (https://imgur.com/a/rXmy1PJ) includes these results under the final evaluation protocol. Mixed resolution achieves 76.53%, followed closely by downscale plus Gaussian noise (76.33%), zoom-out (76.32%), and downscale plus color jitter (76.30%). The three members of Composition A are marked in the figure and all belong to this leading group.
The Figure 2 primarily compares the effectiveness of different augmentation families. Both mixed resolution and zoom-out belong to the information-reduction family and achieve competitive results among the leading operators. Their inclusion therefore reinforces the original conclusion that information reduction is the most effective augmentation family and preserves the insights derived from this analysis. We will revise the paper to reflect the expanded analysis, update Figure 2, and add the omitted operators and their parameters to Table 5.
We also conducted repeated runs of key experiments in composition v.s. single augmentation. Please refer to A1 for details.
>>> W3 Minor: the "EMA teacher." paragraph is duplicated in L457–461. It is not stated whether the student model or the EMA model is used for evaluation. There is no analysis of why the method improves performance on math reasoning.
>>> A3 Thanks for catching the duplicated paragraph; we have removed the paragraph from 448-456.
It is not stated whether the student model or the EMA model is used for evaluation.
We use the student model for evaluation in all experiments. We will revise the paper and add this information to the experiment setup section.
There is no analysis of why the method improves performance on math reasoning.
Thanks for the question. We have two hypothesis: 1. The math benchmarks we use are visually grounded: solving them requires requires accurately extracting visual information, such as geometric relations, chart values, and textual annotations, before performing the subsequent reasoning. We hypothesize that S²VOPD improves this visual evidence extraction process through supervision from the clean-view teacher, helping the student use visual evidence more effectively on these tasks. This provides a plausible explanation for the transfer to visual math despite training exclusively on perception data. Another hypothesis is that S²VOPD training leads to increased response length that allow the model to perform more intermediate reasoning steps, contributing to improved visual math performance. This increase remains stable throughout training, whereas the self-rewarding baselines eventually exhibit degenerate responses and performance collapse.
Thank you again for your constructive review.
We have responded to all the questions and concerns in above comments. As the discussion closes in a few days, we would be grateful to know whether these results resolve your concerns, or whether any specific issue still requires clarification. If the new evidence changes your assessment, we would sincerely appreciate your reflecting that in your final score. Thank you again for the constructive discussion.
Best,
Authors
We thank the reviewer for the constructive review and helpful suggestions. We also would like to express our gratitude to the reviewer for finding our work simple and effective with strong empirical performance.
>>> W1 & Q1Several numbers are inconsistent: base model accuracy is 70.58% in L258–259 but 66.5 in Figure 2(a)(b); Composition B at 4B is 77.28 in the left panel of Figure 2(c) but 76.33 in the right panel; Composition A at 4B is 76.94 in the right panel of Figure 2(c) but 75.89 in Figure 2(d). If the latter two pairs are different seeds, accuracy varies by about 1 point, and many Figure 2 conclusions rely on differences smaller than that. Is my understanding of the reported results correct?>>> A1Thank you for pointing out these inconsistencies. We are deeply sorry for the misunderstanding and confusion caused. These inconsistencies arose from incomplete updates when we changed the evaluation settings, as well as from results imported from Vision-OPD [1]. The differing values for the same configuration reflect the previous and current evaluation protocols, rather than different training seeds. The two protocols are summarized below.We adopted the current protocol because the smaller inference token budget in the previous protocol truncated reasoning traces, resulting in incomplete responses and lower performance. The current protocol yielded better base-model performance and closely reproduced the perception accuracy reported by Vision-OPD [1] (70.58% in our evaluation versus 70.67% in [1]). We subsequently re-evaluated all experiments and models using the current protocol. However, we inadvertently retained results from the previous protocol in parts of the text and Figure 2.
We agree that variation across training seeds should also be assessed, particularly for the smaller composition gains. We therefore repeated the main experiments and the composition-versus-single-augmentation comparisons with three training seeds under the current evaluation protocol.
The main results show low variation across seeds, and the composition improvements persist in the three-seed averages, reaching 0.70% at 4B and 0.62% at 9B. These repeated experiments support the composition-versus-single-augmentation comparison. The effect of stacking weak augmentations has not been evaluated across multiple seeds, and we will qualify that observation accordingly.
We will correct the outdated values, clarify the evaluation protocols and the source of the base-model results, and include mean ± standard deviation for all repeated configurations in the revision.
[1] Yuan, Qianhao, et al. "Vision-OPD: Learning to see fine details for multimodal LLMs via on-policy self-distillation." arXiv preprint arXiv:2605.18740 (2026).