- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ReEnvision to improve execution error correction in long-horizon robotic manipulation. The method jointly represents the anticipated future and action intent, updates this representation based on execution feedback, and predicts which parts of the remaining action sequence are affected. The system then chooses whether to retain the actions, apply local repairs, or perform full replanning. The authors evaluate the method on CALVIN, L-CALVIN, RLBench, and real-world robotic tasks, and analyze the contributions of individual components through ablation studies and controlled experiments on repair locations.
Critical strengths
- The paper asks which remaining actions actually need to change after an execution deviation. Selectively repairing affected actions while preserving valid ones is a sensible approach to limiting error propagation in long-horizon manipulation. The distinction between expected belief evolution and observation-induced revision also provides a clear basis for deciding when to intervene.
- The gains are most apparent at longer horizons, which fits the paper’s motivation. On L-CALVIN, ReEnvision achieves 63% ten-task success compared with 56% for Long-VLA. The ablation replacing selective repair with full replanning reaches 51%, supporting the value of preserving useful actions in this setting.
Critical weaknesses
- The fairness of the baseline comparisons requires clarification. The gap between the reproduced and originally reported BridgeVLA results is insufficiently explained, and the evaluation settings for some baselines in Table 2 are unclear, making the reported gains difficult to assess.
- Validation and training details of the core method are insufficient. Direct comparisons with FFDC and A2C2 are missing, and the generation and selection of training data for the repair model are not clearly described, limiting both assessment of its contribution and reproducibility.
Questions for authors
- The reproduced BridgeVLA achieves a success rate of 85.7%, below the 88.2% reported in its original paper, while ReEnvision achieves 88.8%. The authors should detail the baseline reproduction settings and explain whether this 2.5 percentage-point gap arises from training configurations or other factors.
- Table 2 specifies the ABC→D evaluation setting. However, the entire row of Long-VLA results, including the ten-task success rate of 0.56 and average sequence length of 8.24, matches the results reported under ABCD→D in Table 8 of the original paper’s appendix. The RoboVLMs results also match that table. These settings differ in whether the training data include the target environment D, so directly comparing them may compromise fairness. The authors should verify the table caption and result sources, clarify whether these results were taken from the original papers or obtained through re-evaluation, and ensure that all methods follow the same evaluation protocol.
- The paper repeatedly emphasizes its advantages over FFDC and A2C2, but the experiments lack direct comparisons with these two methods.
- The differences between high-return and low-return action sequences are used as training targets for the repair model, but the procedures for generating and selecting these sequences are insufficiently described.