- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies token-level credit assignment for fine-grained multimodal RL. The authors propose TRIP-Adv, which uses controlled visual interventions and an EMA teacher to estimate token-level visual evidence, calibrates the evidence with verifier agreement and cross-intervention consensus, and sparsely modulates GRPO advantages. Experiments on two 4B backbones and seven benchmarks show clear improvements over GRPO and OPD, together with extensive ablations on evidence construction, calibration, and routing.
Critical strengths
-
I think the method is well motivated. The sufficiency and necessity branches provide a reasonable way to separate task-relevant visual evidence from generic sensitivity to image perturbations.
-
The empirical gains over GRPO and OPD are clear and the ablation is also relatively complete.
Critical weaknesses
-
The comparison with the most relevant baselines is insufficient. The paper discusses VPPO, PGPO, and PRPO as closely related token-level credit assignment methods, but the controlled training comparison only includes GRPO and OPD. This makes it difficult to assess whether the gain comes from TRIP-Adv specifically or from moving from sequence-level to token-level credit assignment more generally.
-
The training pipeline relies on fairly strong privileged supervision. TRIP-Adv requires target bounding boxes to construct the intervention views and additionally uses Qwen3.5-397B-A17B as an external visual judge to filter the training data. This substantially limits the generality of the claimed training framework.
-
I do not agree that the training overhead is particularly modest as currently claimed. The reported step time increases from 275.7s for GRPO to 407.1s for TRIP-Adv, which is roughly a 48% increase. Each rollout also requires four teacher scoring passes.
-
I think the cross-model evaluation is still limited. The two trained backbones are Qwen3-VL-4B and Qwen3.5-4B, so it remains unclear whether the method generalizes beyond closely related Qwen models.
Questions for authors
-
Could the authors provide controlled comparisons with closely related token-level RL methods such as VPPO, PGPO, and PRPO under the same backbone, data, and training budget?
-
How much does TRIP-Adv depend on the target bounding boxes and the external 397B visual judge? Can the method work without these forms of privileged supervision?
-
Could the authors provide a compute-matched comparison with GRPO or OPD, given the roughly 48% increase in per-step training time?
-
Does TRIP-Adv show similar gains on a non-Qwen backbone such as Llama?