- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces DELA, an external controller that refines drafts through INSERT, DELETE, REMASK, and STOP actions while keeping the diffusion backbone frozen. Training combines synthetic recovery, rollout-derived preferences, and task-specific feedback. Experiments report improvements on mathematical reasoning and code generation using append-only drafting followed by sparse global refinement.
Critical strengths
- The controller separates structural editing from token generation without updating the backbone. Reported LLaDA gains span four tasks, including HumanEval improvement from 37.2% to 42.7%, with latency increasing from 5.43 to 5.74 seconds.
- The shared-draft baseline, REMASK-only comparison, and training-stage analysis help explain the gains. The results indicate selective local repair, with remasking accounting for most improvements, rather than broadly successful structural rewriting. The paper also acknowledges that extra inference compute is not fully isolated.
Critical weaknesses
The incremental benefit of structural editing remains insufficiently established.
The contribution of additional inference compute is not fully isolated.
The task-specific training data are insufficiently specified to establish held-out improvement.
Questions for authors
Please identify the Stage 3 training and validation sets for each backbone/task, document overlap checks against benchmark prompts, solutions, and tests, and explain how checkpoints and inference settings were selected.