- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes Perception–Reasoning Fusion-Aware Policy Optimization (PR-FAPO) to improve reinforcement learning for video reasoning. The authors observe that successful video reasoning trajectories can maintain relatively high entropy, while VideoAuto-R1 tends to exhibit entropy collapse and shortened Chain-of-Thought (CoT) trajectories during training. Based on these observations, they argue that video reasoning requires different optimization signals for early perception and later reasoning. PR-FAPO constructs a perception–reasoning fusion gap from probability and entropy statistics over perceptual prefixes and reasoning suffixes. This signal is incorporated into multi-scale segment-level discounting and advantage estimation to produce token-wise weights for GRPO. Experiments on video QA and temporal grounding benchmarks show improvements on several reasoning-oriented tasks, with mixed results on perception-oriented tasks.
Critical strengths
-
The paper studies how probability and entropy change during reinforcement learning for video reasoning. It also compares different training methods and modalities.
-
PR-FAPO improves GRPO by using segment-level information, prefix and suffix statistics, adaptive discounting, and different window sizes, without needing extra visual labels.
-
The paper tests the method on several video QA and temporal grounding benchmarks using Qwen2.5-VL and Qwen3-VL. It also includes ablation studies to show the effects of different components.
Critical weaknesses
-
The main motivation is not well supported. The authors observe that successful video reasoning often has higher entropy and use this to support their method. However, higher entropy does not always mean better perception or reasoning. When visual evidence is clear, low entropy can also be correct. In addition, the paper mainly shows a correlation between entropy and performance, but does not prove that higher entropy during perception leads to better reasoning.
-
The proposed fusion gap may not reflect how well the model uses visual evidence. The fusion gap is calculated from probability and entropy statistics, but these values cannot directly show whether the model correctly understands the video. For example, a model using correct visual evidence and a model reasoning from incorrect visual information may have similar statistics. Therefore, it is unclear whether the method really improves the connection between perception and reasoning, or simply changes the advantage weights based on probability and entropy.
-
The performance improvements are limited and inconsistent. On Qwen3-VL-8B, PR-FAPO improves Video-MMMU from 65.0 to 67.6, but the gains on MMVU (71.1 to 72.2) and MVP (43.0 to 43.7) are small. Performance also drops on MVBench and LVBench. For temporal grounding, Charades-STA improves only from 63.7 to 64.0, while ActivityNet remains unchanged at 51.9. Considering the complexity of the method, these results do not provide strong evidence for its effectiveness.
Questions for authors
see weakness