- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Plan-and-Patch, an agentic planning framework based on diffusion LLMs. The method uses a dLLM to generate structured plans and performs localized plan repair through infilling when execution fails, modifying selected regions based on environment feedback while preserving the remaining plan. The authors also introduce a joint training approach that enables a single model to perform both plan generation and repair, using training data constructed from real execution failures and synthetic perturbations. Experiments are conducted on ALFWorld, TextCraft, and Natural Plan. The results show that diffusion and AR planners achieve similar plan generation success rates on ALFWorld and TextCraft, while diffusion reduces generation latency by 39% - 46%. On Natural Plan, without task specific training, the diffusion planner achieves substantially higher repair success than the AR planner. However, the AR planner still performs slightly better on plan repair in interactive environments.
Critical strengths
-
The paper effectively leverages the bidirectional infilling capabilities of diffusion LLMs to unify plan generation and localized repair. The diffusion planner can modify selected regions using both preceding and following context while preserving unaffected parts of the plan. The authors also introduce a joint training approach that supports both tasks within a single model. This design naturally aligns the strengths of diffusion LLMs with the requirements of agentic planning.
-
The method improved plan generation efficiency with competitive performance. The diffusion planner reduces mean plan generation latency by 39% on ALFWorld and 46% on TextCraft compared with the AR planner, while maintaining similar task success rates. The comparison uses the same task splits, training data, plan representations, and executor. These results demonstrate the practical value of diffusion LLMs for efficient long-horizon planning.
Critical weaknesses
-
The necessity of dLLM is not sufficiently demonstrated. Traditional AR LLMs can also generate replacement content through prompting, given the prefix and suffix of a plan. Although the authors compare diffusion and AR planners, the AR planner achieves higher success rates in the history based repair experiments on both ALFWorld and TextCraft. Diffusion's clear advantage mainly appears in the non-interactive Natural Plan repair setting. The paper does not sufficiently demonstrate the unique benefits of dLLMs over traditional AR LLMs for practical agentic plan repair.
-
Plan repair performance in interactive environments remains limited. In the history based repair setting, the diffusion planner achieves repair success rates of only 14.3% on ALFWorld and 24.5% on TextCraft. On the matched failure set, history based region selection also substantially reduces repair success compared with reference assisted selection. In addition, the interactive evaluation restarts repaired plans from the initial environment state rather than continuing from the point of failure. These limitations raise concerns about the reliability and practical efficiency of the proposed repair approach in long-horizon agent tasks.
Questions for authors
-
Given that AR LLMs can also perform localized infilling, what unique advantages does diffusion provide for plan repair beyond faster plan generation?
-
Diffusion significantly outperforms AR on Natural Plan repair but performs worse on history based repair in ALFWorld and TextCraft. Can the authors explain this discrepancy and clarify under what conditions diffusion provides an advantage over AR for plan repair?
3 comments
The author's response addressed my concern. I will keep my score
Dear Reviewer,
Thank you for your response and for acknowledging that our clarifications addressed your concerns. We sincerely appreciate your constructive feedback and positive consideration of our work.
We thank the reviewer for the positive assessment and for recognizing the motivation behind combining parallel generation and bidirectional infilling.
1. Why diffusion? AR models can also perform localized infilling, as demonstrated by our jointly trained AR baseline. The distinction lies in how the two models perform this operation. Masked diffusion can jointly reconstruct selected positions conditioned on both preceding and following context, including multiple noncontiguous regions, whereas our AR baseline generates replacements sequentially. Recent work has demonstrated related capabilities in variable-length code infilling [1] and template-guided generation, including trip planning [2]. PLAN-AND-PATCH combines these capabilities with parallel plan generation and execution-feedback-driven repair in a single jointly trained model. As shown in Table 1 and Figure 5, diffusion achieves comparable generation success with 39–46% lower generation latency. Our objective is to exploit this efficiency advantage while maintaining competitive planning quality and supporting localized revision.
2. Different repair results. Natural Plan evaluates reconstruction of supplied regions in otherwise valid reference plans, with correctness assessed by constraint validators. In contrast, ALFWorld and TextCraft evaluate jointly trained planners repairing failed generated plans using execution feedback, where success additionally depends on identifying the appropriate region and executing the revised plan. Recent work has also identified challenges involving action consistency and structured outputs in diffusion-based agentic workflows [3].
On Natural Plan, diffusion achieves 53.7% versus 27.0% validator acceptance, with a particularly strong advantage on trip planning (93.3% versus 35.7%), where replacements must satisfy dependencies across different parts of the plan (Table A.10). In interactive environments, the jointly trained AR baseline achieves higher history-based repair success (Table 1). Our region-selection analysis further shows that history-based selection reduces repair success on ALFWorld but improves it on TextCraft (Table A.9). These findings demonstrate diffusion's effectiveness in supplied-region reconstruction while identifying the additional challenges of failure localization and interactive execution. Our repair evaluation uses re-execution from the initial state rather than continuation from the failure state.
References
[1] Wu et al. DreamOn: Diffusion Language Models for Code Infilling Beyond Fixed-size Canvas. ICLR 2026. https://proceedings.iclr.cc/paper_files/paper/2026/hash/7c020dd308d7413b5078686723b2f857-Abstract-Conference.html
[2] Lee et al. Unlocking the Potential of Diffusion Language Models through Template Infilling. ACL 2026. https://aclanthology.org/2026.acl-long.284/
[3] Lu et al. The Bitter Lesson of Diffusion Language Models for Agentic Workflows: A Comprehensive Reality Check. ACL 2026. https://aclanthology.org/2026.acl-long.2036/