- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Collaborative Speculative Decoding (CoSpec), which learns to arbitrate disagreements between draft and target models to improve generation quality and inference efficiency jointly. An arbitrator uses a hybrid attention mask to access the context, draft block, and target verification tokens, and is trained through supervised warm-up followed by reinforcement learning on complete generation outcomes.
Critical strengths
- The paper provides evidence of improved task quality while retaining parallel verification.
- In this paper, SFT-only training, judge-free RL, reward ablations, target-model RL, and counterfactual branch analysis provide complementary evidence about the source of the gains.
Critical weaknesses
- There is no direct experimental comparison with DIVERSED, and comparisons with CoSD and AutoJudge have limited coverage.
- The causal-mask ablation removes both bidirectional interaction and target-token visibility, preventing isolation of the hybrid attention contribution. CoSpec and the target-RL baseline also use different training compute budgets.
Questions for authors
- How much improvement does hybrid attention provide over a causal or interleaved arbitrator when target verification tokens remain visible?
- Does CoSpec still win on both score and speed against CoSD, AutoJudge, and DIVERSED under one protocol?
- Does the 78% versus 20% acceptance gap in Table 3 remain under a different continuation policy?