- Rating
- 3
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work suggests that having the robot return to a more promising state along its historical trajectory, then observing and executing, may improve the overall success rate. The core of this approach is to determine “when to intervene” and “where to backtrack.” This work freezes VLA and uses rollout data to train a critic. Classifier use Q-value to assess the risk of failure; once triggered, system selects the historical state with the highest V-value.
Critical strengths
The motivation is sound, and the approach is simple yet effective, using Q to estimate risk and V to select historical states.
The writing and presentation are clear and easy to understand, such as Figure 1.
Critical weaknesses
One prerequisite for the method to work is that the scene remains static for most of time in task execution; the method only tracks the robot state and does not account for changes to the scene or objects that may occur during task execution. There has not been sufficient discussion on whether this affects method’s effectiveness.
The real-world experiment was small in scale.
Questions for authors
On average, how much additional time does this method add to each task execution.
It is generally believed that the Q-value for robotic manipulation tasks is difficult to estimate stabilityand can become a performance bottleneck; therefore, various approaches, such as training multiple critics, are typically employed to ensure stability. How does the stability and overall performance of the critics in this work? Although there are some methods in this work for optimizing stability, such as considers some of the recent Q-values, these are relatively lightweight.
See the weakness; consider providing some discussion or supplementary information for each point to support the main idea of the work.
reviewer discussion
Dear Reviewers,
The authors have submitted their rebuttal. Please read their response carefully and engage in the discussion as soon as possible. Let us know whether the rebuttal addresses your concerns and update your final rating accordingly.
Thank you for your time and service to ICLR.
Best regards,
AC