- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Ripple-Pivot Search selects a pivot position and explores alternative token assignments through parallel branches. It scores each branch by the mean entropy of the remaining masked positions, regularized by the candidate's probability under the anchor branch. Experiments on LLaDA, Dream, and LLaDA-1.5 compare accuracy and throughput against existing decoding methods, including LoPA.
Critical strengths
Tables 1 and 5 show higher throughput than LoPA in 10 of 12 settings, together with higher average accuracy. These results provide evidence that the proposed search can improve decoding on the tested models. The paper also evaluates combinations with caching.
Critical weaknesses
-
The experiments are limited to LLaDA-8B, Dream, and LLaDA-1.5. The large reported speedups mainly use sequential decoding as the reference. There is no evidence that the additional search remains worthwhile on a competitive model such as SDAR with its native decoding and caching.
-
The branch-isolation claim needs clarification. Figure 2 appears to allow shared context to attend to branches and branches to attend back to shared context. Across layers, this could let one branch affect another. The actual attention mask and a comparison with independent branch evaluation are needed to establish correctness.
Questions for authors
-
On SDAR or another competitive model, does RPS improve accuracy at equal runtime over LoPA and confidence-based decoding with caching? Please include the search overhead and peak memory usage.
-
Can shared-context states read branch states during the packed forward pass? Please provide the attention mask and show whether each packed branch produces the same logits as an independent forward pass.
Dear Reviewer KPYQ,
Thank you again for your detailed review and valuable suggestions. As the discussion period draws to a close, we would be grateful if you could let us know whether our responses have addressed your concerns. If anything remains unclear, we would be happy to discuss it further.
Best regards,
The authors of Paper 9849