- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Pixel-OPSD, an on-policy self-distillation framework for pixel-level multimodal large language models. It addresses the limited granularity of scalar outcome rewards through reliability-routed caption correction, which selects replacement, refinement, or retention based on reconstruction reliability. Additional supervised anchors preserve grounding accuracy and semantic completeness. However, the joint training objective requires further clarification.
Critical strengths
- The paper addresses an important limitation of scalar outcome rewards. Distinguishing semantic errors from spatial errors is particularly relevant when language and mask tokens are generated autoregressively.
- Experiments cover referring segmentation, interactive segmentation, general grounding, and region understanding, providing reasonably broad evaluation.
- Counterfactual evaluation offers an interesting approach to distinguishing coarse and fine mask-code contributions.
Critical weaknesses
-
Insufficient analysis of computational overhead. Teacher-based caption generation, repeated localization verification, and counterfactual mask decoding introduce additional costs. GPU-hour reporting and compute-matched comparisons with CycleGRPO are needed.
-
Limited hyperparameter sensitivity analysis. More systematic analysis is needed for , , , , and , particularly the routing thresholds and EGCA mixing coefficient.
-
Unclear formulation and justification of the joint objective. Equation (15) combines advantage-weighted policy optimization, JSD-based distribution matching, and teacher-forcing supervision. The notation, loss weighting, and compatibility of these optimization signals are insufficiently explained.
Questions for authors
-
How are , , and selected? How sensitive are results to these coefficients, given the potentially different loss scales and gradient magnitudes?
-
Only the refinement branch appears to perform distribution-level on-policy distillation; replacement uses teacher-forcing NLL, while retention applies no auxiliary caption correction. How should the scope of ''on-policy self-distillation'' be understood across these branches?