- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Revisable Temporal Planning (RTP), a framework that enables world-action models to revise persistent visual plans based on execution feedback, rather than always restarting the generation process. The method introduces a learned revision bridge that resumes from intermediate diffusion states, a time-aware history representation to incorporate observed evidence, and an adaptive selector that chooses between retaining the current plan, revising it, and performing fresh replanning. Experiments on RoboMME and RMBench report task success rates of 48.6% and 84.8%, respectively. The results suggest that feedback-conditioned plan revision can improve task performance, although the contributions of individual components and the advantages of some design choices remain insufficiently established.
Critical strengths
- The paper addresses a practical problem in world-action models: how to incorporate execution feedback without unnecessarily discarding an existing predictive plan. The distinction between retaining, revising, and restarting a plan is meaningful for closed-loop planning.
- The paper includes a range of experiments and ablations covering revision strategies, checkpoint sources, history configurations, and training losses. The results provide encouraging evidence for the learned revision mechanism, particularly compared with zero-residual correction.
Critical weaknesses
- The ablation studies lack a systematic, incremental analysis from a common baseline, leaving the marginal contributions and interactions of key components unclear.
- The advantage of adaptive update selection remains statistically uncertain. RTP achieves 48.63% success, compared with 47.38% for fixed Bridge-10 and 46.38% for binary retain/fresh, but paired confidence intervals are not reported.
- The independent benefit of saved checkpoints is not fully established. Although native checkpoints outperform root-noise reconstruction (47.4% vs. 44.6%), the reported 95% confidence interval for the difference includes zero.
- The reliability of discrepancy metrics as indicators of task performance remains unclear. In Tables 13–14, recurrent fitting substantially reduces discrepancy tolerance exceedances but improves task success by only 0.125 percentage points, suggesting that improvements in these metrics do not necessarily translate into better task performance.
Questions for authors
- Could the authors provide a more systematic component-wise ablation, including controlled comparisons that quantify the marginal contributions of the major components and examine potential interactions between checkpoint reuse, learned revision, and adaptive update selection?
- Could the authors report paired confidence intervals for the success-rate differences between RTP and the fixed Bridge-10 and binary retain/fresh baselines, to clarify whether the observed improvements are statistically reliable?
- Given the uncertainty in the checkpoint-source comparison, how essential is the use of saved native checkpoints to the overall performance of RTP? Could the authors further isolate its contribution from that of the learned revision bridge?
Thank you for the detailed response and additional experiments. The new ablations and statistical analyses address several of my concerns and strengthen the empirical evaluation. I appreciate the authors' efforts in providing these additional results and clarifications. After considering the response, I will maintain my current rating.