- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes process-continuation learning for generating text continuations based on the current context. The authors argue that standard SFT is not ideal because it treats one observed continuation as the unique target, although multiple continuations may express the same intent. They therefore train a policy with GRPO, using GPT-5.6 Luna as a user agent that evaluates the generated continuations.
Critical strengths
(S1) The paper tackles the interesting problem of text suggestion.
(S2) The paper provides an intuitive training framework.
(S3) The two-stage curriculum Stage I: local validity and Stage II: semantic alignment is a clever way to tackle the problem.
Critical weaknesses
(W1) Could the authors also compare against stronger baselines than SFT, such as direct preference optimization methods?
(W2) The method relies on GPT-5.6 Luna to evaluate generated suggestions during GRPO training. This dependence on a closed model makes the method difficult to reproduce. Could the authors run experiments using a fully open-weight pipeline?
(W3) The authors only provide experiments in which Qwen3-8B is the trainable policy updated with GRPO. It would be beneficial to evaluate another model family, since recent work indicates that GRPO behavior can be highly model-family-dependent and that Qwen models may improve even under spurious rewards [1].
References
[1] Shao, Rulin, et al. "Spurious Rewards: Rethinking Training Signals in RLVR." arXiv preprint arXiv:2506.10947 (2025).
Questions for authors
see weaknesses