- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DyCPO, a self-diagnostic token-level optimization framework for video reasoning. One interesting aspect of the paper is its re-examination of the common assumption that high-entropy tokens are always the most important targets for reasoning optimization. The authors show that many vision-dependent and answer-dependent tokens can actually lie in the low-entropy region, and that optimizing only high-entropy tokens may over-emphasize exploration while missing stable visual or decision-critical cues. Based on this observation, DyCPO jointly measures visual and answer sensitivity through counterfactual interventions, selects multi-role tokens, and applies token-level contrastive optimization together with GRPO. The counterfactual visual signals are further adapted using successful and failed rollouts rather than relying only on static perturbations.
Critical strengths
- The analysis of entropy versus key tokens is interesting and well motivated. The paper provides empirical evidence that high entropy does not necessarily correspond to the most useful tokens for video reasoning, and that a substantial portion of visually grounded or answer-critical tokens can be missed by entropy-only selection.
- The distinction between vision-dependent and answer-dependent tokens is useful. The paper shows that visual sensitivity is concentrated more in earlier decoding stages, while answer sensitivity tends to appear later, supporting the motivation for multi-role token selection rather than a single criterion.
- The self-diagnostic counterfactual design is a meaningful component. Using successful and failed rollouts to adapt the counterfactual signal makes the intervention dependent on the evolving policy rather than completely static.
- The empirical results are strong and consistent across a broad range of video reasoning and understanding benchmarks.
Critical weaknesses
- The method incurs around 20–40% additional training cost per step compared with GRPO. While this overhead is non-trivial, the consistent gains across benchmarks make the trade-off reasonably acceptable.
- The self-diagnostic keyframe localization relies on response-to-frame attention. Although the paper provides layer-wise ablations and qualitative visualizations, a direct intervention test would make this design more convincing. For example, comparing the accuracy drop after masking the selected keyframes against masking random or low-attention frames could provide stronger evidence that the identified frames are causally important rather than merely correlated with model attention.
Questions for authors
see weakness