- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Cord, a lightweight prompt-conditioned policy that retains confidence decoding as a reference and learns when and how to depart from it through geometric residuals over generation direction. Experiments on several reasoning, code and constraint-satisfaction benchmarks show improved task success and further improves over the best per-domain fixed residual.
Critical strengths
- The overall method is simple and computational cheap. Moving exploration from per-step position actions to a single 24D coefficient program per rollout is good idea. It turns a long-horizon credit-assignment problem into a contextual bandit.
Critical weaknesses
- The claim that learned prompt and state adaptive residuals are important is not supported. For the Table 1, the gap between CORD and Best per-domain fixed residuals are very close, and some even lower.
- The paper did not compare with any learned based policy baseline like [1]. And every experiment uses one token per step, which curernt dllms often uses multi token per step or block decoding. It is unclear whether how CORD would perform in these settings.
[1] Learning Unmasking Policies for Diffusion Language Models, Jazbec et al, 2025.
Questions for authors
Please check the weakness above.