- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how robots use the current task history and past experience to generate actions. The method uses within-episode memory to infer what needs to change, retrieves actions from previous episodes, and assesses whether their predicted effects fit the current situation. A shared gate controls how much the retrieved experience influences both the conditioning and the flow initialization. Experiments on LIBERO, RMBench, and real-world robot tasks, together with retrieval distraction tests and component comparisons, show benefits from selectively reusing past experience.
Critical strengths
-
The problem is meaningful, and the motivation is clear. An action that worked before may not be appropriate now, especially when the robot needs to track task progress or decide whether to repeat an interaction. The method goes beyond retrieving similar experience and checks whether it fits the current need, which is useful for robot control.
-
The approach allows flexible reuse of experience. Retrieved actions serve as references that the model can adapt to the current scene, and their influence can be reduced or removed when they are not useful. This lets the robot benefit from past experience while remaining responsive to the current situation.
Critical weaknesses
The overall advantage and generalization ability are still unclear. RMBench uses task-specific models and configurations, and retrieval includes task identity. The overall gain over the strongest baseline is small, with clearer improvements concentrated in some tasks requiring multiple past observations. The results therefore provide stronger support for experience reuse within known tasks than for a unified policy that handles new tasks.
The evaluation/demos in this paper are also limited in scope, as all the experiments focus on tabletop manipulation.
Questions for authors
-
How much does the system depend on the quality and diversity of past experience? How closely must the stored examples match the current task to be helpful? For example, if a plate is in a different position from where it was in the retrieved demonstration, how does this affect action adaptation and task success?
-
When the experience bank lacks relevant skills, rather than just containing some misleading candidates, can the gate reliably suppress the retrieved experience? Does performance remain at least comparable to a policy without retrieval in this setting?
Thanks for the additional experiments. The new comparisons and analysis help clear up several of my concerns, especially about the contribution of the proposed method and its inference cost. I still think the experiments could cover more tasks, and a more direct comparison with related methods would be useful. But overall, the response is convincing enough for me to keep my Weak Accept rating.