- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose a visual contrast-guided reinforcement learning framework that uses a self-EMA teacher to identify tokens sensitive to visual input and then selectively modulates those tokens during RL training. Experimental results show that VC-RL outperforms various methods on high-resolution and fine-grained visual understanding tasks.
Critical strengths
-
The proposed VC-RL outperforms various methods across different benchmarks.
-
Selective token modulation based on different visual regions is interesting and appears effective.
Critical weaknesses
-
The contribution seems limited, given that prior work, RLCSD [1] , has already proposed token-level selective self-distillation.
-
There is a lack of empirical analysis of the selected tokens and how reliably they are associated with visual evidence.
Reference:
[1] RLCSD: Reinforcement Learning with Contrastive On-Policy Self-Distillation
Questions for authors
Any analysis show selected token match the visual evidence?