- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposed TASKANCHOR, a novel model structure to identify the task state problem that causing latency in the long-horizon manipulation tasks that requires the robot to (1) know the current subtask stage and (2) able to recover history-grounded task context. Contect-adaptive visual conditioning and Task-state coordinate prediction and conditioning jointly optimized the memory bank and trained the TASKANCHOR that is used for conditioning the ReactiveVLA. The paper is in good quality and the research problem is novel. Evaluation on RMBench and RoboMemArena demonstrate the effectiveness of the proposed method.
Critical strengths
- The paper is researching task state aliasing problem, which is novel and important for current VLA paradigm for long-horizon tasks.
- The proposed TASKANCHOR is novel and useful to build a good memory bank to solve the "same observation, different intended action" problem.
- The experimental results on RMBench and RoboMemArena benchmark demonstrate the effectiveness of the proposed method. It improves long-horizon performance over prior methods.
- Ablation study verifies the effectiveness of the added feature of Coordinate and history observation.
- Only 2ms of additional latency is acceptable even though the TASKANCHOR brings additional model weight.
- Project page is stunning.
Critical weaknesses
- In long-horizon tasks, sometimes the robot will face failure and recovery. Say the robot was told to "move a red block onto a blue pad and then return it to its original slot", if the robot mistakenly returned the red block to the wrong slot, and retried to pick it up and place it to the original slot. In this failure recovery process, does the failure process counts history memory?
- What if a robot moves wrong at the very beginning of the manipulation so the accumulated memory is negative?
- Using TTT to compress sequence history is a controllable way to store history content. But will it bring forgetting as the task horizon increases? It will be good to show the relationship between the model performance and the task horizon.
Minor:
- Position of Table 3,4,5 are awkward.
Questions for authors
See weakness