- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Proact-VL2 studies open-ended proactive video interaction, where several speaking times and contributions may be appropriate. The authors construct OpenProact across solo commentary, collaborative commentary, guidance, and collaborative presentation. A weighted SFT policy based on Qwen3-VL-4B is further trained with GRPO on causal 20–50-second trajectories, using a multimodal trajectory-quality reward, MM-TrajQ, and a per-step length penalty. Evaluation includes in-domain and held-out-domain interaction, general video understanding, behavioral diagnostics, and a paired human study. The main contribution is an empirical training framework for context-sensitive proactive behavior, rather than a new RL optimizer.
Critical strengths
- Quality improvements have evidence beyond the optimized judge. The paired human study compares the same 20 clips across systems, with three ratings per clip–model pair. RL improves the mean human score over SFT by 2.32/10, with a paired-bootstrap interval of [1.63, 3.02], and is rated higher on 19 of 20 clips. Appendix D explains blinding, aggregation, and agreement. This is a substantive reason to view the reported behavioral improvement as more than self-evaluation.
- A coherent objective with a reasonably complete experimental package. Multiple valid trajectories are a concrete motivation for moving beyond reference imitation. Same-initialization reward comparisons, length-penalty ablation, 481 held-out-domain clips, and checks on general video understanding support the practical training contribution. The appendix provides detailed prompts and optimization settings and the paper supplies anonymous code/data-construction links, although their executability was not verified in this assessment.
Critical weaknesses
- The distinct role of trajectory-level feedback is not isolated. Prior work already includes multi-turn RL for proactive interaction (MMDuet2) and proactive commentary/guidance (Proact-VL). Here, standard GRPO assigns one trajectory advantage to all generated tokens. Comparing PAUC against MM-TrajQ changes semantic content, visual evidence, reference dependence, and temporal scope together. Thus, Table 2 shows the usefulness of this reward, but not whether modeling cross-decision dependencies is the decisive ingredient. A stepwise or short-window semantic reward using the same judge and evidence would clarify the claimed empirical insight.
- The scope of interaction-quality validation remains limited. MM-TrajQ is both the training reward and a main evaluation metric, while LiveU and FinalQ use the same GPT-5.2 judge. The human study meaningfully mitigates this dependence, but contains only 20 independent clips and does not establish all reward-comparison or OOD conclusions. Collaborative evaluation also replays a fixed partner track that cannot react to the model, so it measures coordination with a scripted timeline rather than fully reciprocal interaction. The conclusions should retain this scope and acknowledge trade-offs: guidance F1 decreases from 0.638 to 0.525 after RL, and OOD LiveU decreases slightly from 5.75 to 5.70. These limitations temper, rather than negate, the positive human evidence.
Questions for authors
- Decisive mechanism control: Is there a comparison with stepwise or short-window semantic rewards using the same judge, multimodal evidence, rollout budget, and training initialization? How much gain is specifically attributable to whole-trajectory context?
- Independent validation: Which interaction categories and OOD domains are covered by the 20 human-evaluated clips? Is there human or independent-judge evidence comparing MM-TrajQ-trained RL against the strongest PAUC reward variant, rather than only SFT?
- Interpretation of behavior: Does RL reduce speaking coverage or frequency in guidance, and how does that relate to the F1 decrease? Please clarify which coordination claims are supported under a fixed partner track, and whether any results involve a partner that responds to the model.
2 comments
Human study. As suggested, we ran a blinded pairwise human study with no rubric or judge prompt. Annotators watched the same clip with two models' commentary side by side and simply chose which side is better (20 clips, 5 annotators, 150 votes).
| Our RL vs. | Win rate |
|---|---|
| MMDuet2 PAUC | 74% |
| Our SFT | 68% |
| Proact-VL | 86% |
We would be grateful to know whether these results address your concerns. If anything remains unclear, we would be happy to provide further clarification or additional analyses.
W1/Q1 (The distinct role of trajectory-level feedback is not isolated)
To address the reviewer’s concern, we added a single-step semantic-reward ablation using the same SFT initialization, four rollouts per context, the same length penalty Plen, and the same number of training steps. Each judge call scores only the model’s speech or silence at second t, with frames, reference utterances, and partner speech from t−5 to t+2 seconds. This context helps identify the event and whether speaking at t is appropriate. The per-second scores are averaged into one rollout reward for GRPO. As shown in the table below, single-step scoring can favor silence because the judge cannot see how the model will complete its utterance. For example, “Keep the lid…” does not yet convey a useful instruction; its value becomes clear only with the subsequent “slightly open to let steam escape.” Even with preceding context, the judge cannot assume this continuation. The unfinished instruction therefore receives less credit than appropriate silence, whereas trajectory-level evaluation can recognize the complete contribution.
W2 & Q3 (The scope of interaction-quality validation remains limited)
MM-TrajQ is one of several reported metrics, and our conclusions do not rest on it alone: judge-free overall F1 remains comparable (.784→.780), while LiveU (6.06→6.32) and FinalQ (4.77→5.36) improve. Although these metrics share the GPT-5.2 judge, their prior validation against human judgments on 100 instances [1], together with our own human study favoring RL on 19 of 20 clips, provides supporting evidence beyond the training reward. For collaborative interaction, the fixed partner track provides a controlled setting in which models face the same partner utterances and timing, allowing us to assess coordination while limiting variation introduced by the partner. A reactive partner would make future inputs depend on the model’s actions, complicating credit assignment and reproducibility; jointly training both agents would additionally introduce non-stationarity as each partner’s policy changes. We therefore view this work as a first step toward RL for proactive collaboration, with demonstrated gains under a fixed-partner protocol.
Q2 (Coverage of interaction settings in human study)
The 20 clips cover all four settings. Human ratings per setting:
We will additionally conduct a human study with pairwise comparisons among our SFT model, our RL model, and the MMDuet2-PAUC variant.
Q3 (Why RL lowers F1 in Guidance)
We acknowledge that our RL model underperforms MMDuet2-PAUC and our SFT model on F1 in Guidance, one of our four scenarios .525 (RL) vs. .620 (MMDuet2-PAUC) and .638 (SFT) and have removed the claim of uniform improvements across all four settings. The main cause is that RL speaks less in Guidance. Compared with SFT, recall drops from .789 to .481. Guidance requires instructions before specific actions, so its timing constraints may favor SFT or PAUC’s direct optimization of reference alignment. In the other three settings, our reward improves both F1 and FinalQ over both PAUC variants. These more open-ended settings admit multiple appropriate responses and speaking opportunities, which may benefit from evaluating the quality of the complete interaction rather than agreement with a single reference trajectory. We now discuss this distinction explicitly in the paper.