- Rating
- 2(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Through experiments involving shared initialization, partial gradient recovery, directional interventions, optimizer state swapping, relevant content replacement, and comparisons under realistic training budgets, the paper systematically investigates how visual compression affects learning and demonstrates consistent recovery effects across multiple models.
Critical strengths
(1) The experimental design of this paper is particularly valuable. Rather than merely comparing final performance scores, the authors also branch from the same training state, keeping the data order, learning rate, and gradient clipping settings fixed, while varying the gradient contributions provided to the optimizer.
(2) The paper compares six learner configurations. In addition, the authors conduct short-horizon branching experiments with different sets of trainable modules, including projector-only, projector plus LoRA, a broader set of non-visual parameters, and the final few visual modules. These experiments provide evidence that the recovery effect generalizes to some extent across different models and scopes of trainable parameters.
(3) The paper clearly reports the conditions under which the proposed method does not outperform the alternatives.
Critical weaknesses
(1) The paper offers limited standalone algorithmic novelty, with its main contribution lying primarily in the empirical analysis.
(2) I did not find a comprehensive comparison with the full DualSpeed method under the same dataset, model, and computational budget.
Questions for authors
Could the authors clarify the relationship between “No inverse probability” and “View mixture”? If the implementation of “No inverse probability” is defined as , then under the same training state, sampling outcomes, and optimizer settings, the gradient is when and when . Under ideal arithmetic, this appears to be mathematically equivalent to the gradient construction used in a standard view mixture. However, the paper reports different results for these two approaches: 80.03 for “View mixture” and 80.31 for “No inverse probability” (Tables C.2–C.3, Page 23). Could the authors explain what implementation or experimental differences account for this discrepancy?