- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a method, "Deep Think with Rehearsal," to decouple the reasoning from the real-time interaction. They find that the method can greatly reduce the time for first token response, and increase the quality of the response. Their quantitative results show both scores from ROUGE-1 and human evaluation from 200 feedback instances.
Critical strengths
This is an interesting and clean idea motivated by a real-world setting. The positive results also converge with the intuition that 'reading in advance' will help the retrieval in real time more than 'reading on the fly'.
Critical weaknesses
The quantitative method needs more rigorous evaluation. The ROUGE-1/BLEU score is not a good metric for this task as it misses the semantic information. The human evaluation is also not convincing, as many technical details are underspecified; for instance, the distribution info is missing, and there are no error bars.
Questions for authors
A previous paper (arXiv:2504.13171) seems to propose a similar idea, yet the authors did not cite it. Can the authors comment on this prior work and clarify the novelty of their method?