- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies the task of continual embodied instruction following for long-term human-agent cohabitation. The task can have downstream applications such as home service, elderly care and autonomous inspection. At the core of the task, a key challenge is that in the open environment, the environment state can change dynamically by humans, so the agents have to always update their recognition of the environment. Therefore, the authors propose RoboState, a framework that parses an instruction into goal states, aligns and tracks the current states of the relevant objects, and constructs an executable plan from the current states to the goal states. The experiment results at different settings show that the proposed method outperform previous state-of-the-art methods.
Critical strengths
The problem setting the paper studies is important. A key challenge in long-term human-agent cohabitation is that the agent has to constantly update its understanding and recognition of the open environment, as the states can change because of human activities. It is good to have the paper focus on this setting.
Critical weaknesses
-
It would be better if the authors can include more qualitative examples and analysis in the paper to show how their method helps improve the task of continual embodied instruction following for long-term human-agent cohabitation. In this way, the audience can learn more insights from the study and get more intuitive insights on actually how the proposed framework works.
-
The presentation of the paper needs to be improved. In Section 4 Experiment, there are multiple issues: (a) ExRAP benchmark (?); (b) Appendix ?? provides; (c) Instruction scale. columns 1-3 of (should be Columns). These indicate that the paper had not been carefully checked and proofread at the time of submission. I do not think the current version with several obvious presentation problems is ready for ICLR. In addition, the authors have not highlighted the best result in the experiment tables. It would be much better if the authors can do so and then it would easier for the audience to understand how much improvement the proposed method actually brings.
Questions for authors
As in Weakness 1, could you please give more examples on how actually the proposed framework help improve the long-term continual embodied instruction following task?
I would suggest the authors to address my concerns as in the weakness section during the rebuttal.