- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies silent negative transfer in verifier-guided self-training for vision-language models, where improvements on self-training data do not translate into gains on held-out data. The authors distinguish two potential sources of failure through gradient fidelity and gradient transferability, and derive a Safe-Transfer Margin. They further propose Asymmetric Acceptance Gating, which filters preference pairs based on the verifier's confidence in the chosen response. Experiments on MathVista and MMMU show that AAG improves preference quality and generally outperforms raw verifier-guided DPO on held-out evaluation.
However, I find the motivation insufficiently supported by the empirical evidence, particularly regarding the prevalence and underlying causes of the claimed negative transfer phenomenon.
Critical strengths
-
The paper provides a useful conceptual distinction between gradient fidelity and gradient transferability.
-
AAG is straightforward to implement.
Critical weaknesses
-
The motivation relies primarily on the MathVista–MMMU comparison. However, the average held-out degradation on MMMU is modest (−1.42 points), and only four of six configurations exhibit negative transfer. This raises concerns about whether the phenomenon is sufficiently systematic and significant.
-
MathVista and MMMU differ in task difficulty, domain composition, and data distributions. It is unclear whether the degradation results from verifier unreliability or general self-training limitations. Notably, even ground-truth preference supervision yields only +0.80 points on held-out MMMU, suggesting that poor transferability may be the primary bottleneck.
-
Although the paper includes ground-truth preference and matched-budget filtering controls, it lacks systematic comparisons with verifier-independent self-training strategies. Consequently, the extent to which negative transfer is specifically caused by verifier errors rather than generic self-training overfitting remains unclear.
-
The gradient fidelity/transferability framework provides an interesting interpretation, but AAG is essentially a confidence-based filtering strategy that does not directly depend on this theory. In particular, the theoretical results do not establish that higher chosen-response precision necessarily leads to better gradient alignment or held-out generalization.
-
The MMMU held-out set contains only 200 examples, and the reported performance differences are relatively small. Multi-seed experiments are limited to Qwen3-VL-4B, while larger learners primarily use a single seed. The lack of held-out confidence intervals makes it difficult to assess the statistical reliability of the findings.
Questions for authors
-
Can the authors provide stronger evidence that silent negative transfer is systematic across tasks and model configurations?
-
How can the authors distinguish verifier-induced failures from poor self-training generalization, given the limited gains from ground-truth preferences?
-
How would verifier-independent self-training baselines perform under matched training budgets?
-
Can the authors clarify the theoretical connection between AAG, gradient fidelity, and held-out generalization?
-
Are the reported held-out differences statistically significant and robust across data splits and random seeds?