- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Stream-of-Thought, a streaming vision-language model that accumulates reasoning while observing video and separately decides when to speak. Staged supervised fine-tuning and Think–Speak Group Policy Optimization train these behaviors. The authors evaluate reactive and proactive assistance and introduce UnpromptedBench for assessing unsolicited interventions.
Critical strengths
-
Separating thinking from speaking allows the assistant to retain information for later questions without turning every state update into an interruption. The evaluation across both types of task makes this a useful contribution to streaming assistance.
-
The ablations show that the hidden-quiz reward improves recall of earlier video content and decision-local credit reduces repeated responses.
Critical weaknesses
-
The caption of Table 10 says the unregularized run achieves the highest average, although it scores 57.03 versus 64.37 with entropy regularization. The SFT OVO score is 59.60 in Tables 5 and 10 but 59.93 in Table 7. Reasoning rates also differ. Are these editorial errors, or were different checkpoints or measurement definitions used?
-
UnpromptedBench results use the development split, with SoT covering five of 237 reference opportunities. Precision also credits help outside the catalog, but the stratified expert audit rejected eight of twenty sampled responses that the automatic response-quality evaluator had passed. I would like to see whether the ranking holds on the held-out split or in a blinded human comparison.
Questions for authors
-
Could authors reconcile the scores, reasoning rates, and caption in Tables 5, 7, and 10, specifying the checkpoints and measurement definitions? Please also check the Qwen3-VL-4B aggregate in Table 1: its reported component scores average to approximately 62.62, whereas the final column gives 62.12.
-
Are held-out results or a blinded human comparison available for UnpromptedBench? Paired video-level uncertainty estimates for the main comparison would also be helpful.
4 comments
Follow-up on Author Response
Dear Reviewer Xjvm,
Thank you again for your time and valuable comments. As the discussion period nears its end, we would like to follow up on our author response and revised manuscript. We would appreciate any further feedback and would be happy to clarify any remaining concerns.
Best regards,
The authors
Thank authors for the held-out results and paired uncertainty estimates. These strengthen the evidence that the ranking holds. My remaining concern is that held-out coverage corresponds to only 2 of 81 opportunities, while the bootstrap intervals quantify video-sampling uncertainty conditional on the unchanged automatic evaluator. A brief clarification of whether these two matches were independently verified by a human would be helpful.
Additional response to reviewer Xjvm
Thank you for the follow-up. We are glad our response was helpful in addressing your earlier concerns.
Following your comment, we asked the expert reviewer to check whether each of the two held-out replies delivers the same help as its matched opportunity. The reviewer labeled these pairs mixed with eight unmatched pairs from the same split, without seeing the evaluator's decisions or rationales, and confirmed both semantic matches. We have added this check to Appendix I.4 of the revised paper.
We hope this addresses your remaining concern, and we would be glad to clarify anything further.
Response to reviewer Xjvm
We thank the reviewer for the valuable suggestions and comments. To answer the questions/comments:
Consistency across tables. We checked the reported results against our training logs. The entries in Table 5 are correct. We corrected the Qwen3-VL-4B aggregate in Table 1 and the entries in Appendix Tables 7 and 10 that had been inadvertently mixed across checkpoint versions. We also corrected the caption of Table 10. We appreciate the reviewer bringing these reporting errors to our attention.
The reasoning rates differ because they are measured at different checkpoints in RL training, not by different definitions. Table 5 studies how each SFT schedule affects RL, so its RL column reports the rate at the same middle checkpoint for every schedule. Table 10 reports the rate before RL and at the checkpoint evaluated in Tables 1 and 2. We now clarify this in the manuscript. For the reviewer's reference, the final reasoning rates of Table 5's runs are:
These final rates lead to the same conclusion as indicated in Section 5.2.
Held-out results and uncertainty.
Held-out results. We scored all works on the held-out split with 157 candidates, of which 81 opportunities are accepted by a strict majority of three complete ratings. We used the same settings as on the development split, and the evaluator is unchanged from Table 2.
The ranking holds as on the development split. SoT is the only one that covers any held-out opportunity. It ranks first in coverage and F0.5, and its precision (45.6%) exceeds that of every prior work except StreamOPD, whose 3 replies are too few to compare. Appendix I.4 gives further details.
Paired video-level uncertainty. For the main comparison, we resample whole videos 10,000 times, keeping the number of videos from each source fixed, and score SoT and every prior work on the same resampled videos. The paired difference, SoT minus each prior work in Table 2, ranges from +7.1 to +8.9 in F0.5, with every 95% interval above zero. Against every prior work, SoT has the higher F0.5 in 99.6% of the resamples. The smallest difference, against Em-Garde, is +7.12 [+2.12, +12.31]. In precision, the paired difference ranges from +17 to +46. Appendix I.1 (Tables 15 and 16) gives the detailed intervals and paired differences for every model and metric, and Appendix I.4 (Table 19) those for the held-out split.
The expert audit and credit outside the catalog. We added three checks to further verify the ranking.
We have added the held-out results, the paired intervals (now in Appendix I) and these checks to the revision.