- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper considers the setting of generative robot policies using action chunking, where policies execute a prefix of predicted actions in the environment before predicting a new chunk. The paper states that a problem exists in this setting, as policies may only observe the current observation, and thus, may not have sufficient history to predict actions. However, instead of casting this as a standard setting for history, the paper introduces the terminology of a “cross-query coupling”, which seems to describe a joint distribution between the policies history and the predicted action chunks. Later, the paper discusses that the policy should be aware of history, and then proposes “Stateful-Requery”, which uses a recurrent state m to capture history over proprioceptive information and elapsed time. The paper evaluates adding their method to policies on Libero-90 and MT50 as additions to policies, but does not compare to prior work improving policies for partial observability/history, although related work is partially discussed in the paper.
Critical strengths
Strengths:
- The paper studies the problem of integrating history into policies, which is an active area of research.
Critical weaknesses
Weaknesses:
-
The writing of the paper is very unclear. This is across the problem being studied, the gaps of prior work, the proposed contribution.
-
The proposed methods appears to be a recurrent state baseline and is not compared to prior work
-
The paper introduces a large amount of unclear jargon, which is not situated within the literature, for example:
“We call this repeated generative handoff requery”,
“diagnosis of branch-relative continuation value. We turn the criterion into a fixed-bank test, exposing branch-dependent value”
“One query, physical commitment, and return to the interface obey”
The use of the word fiber: “Every candidate gap is unchanged across histories in the fiber”, “they form the interface fiber”
Overall from a presentation, and clarity point of view, I would recommend for the writing of the paper to be completely revised, and simplified. Technically, the paper also lacks both theoretical and empirical study of existing methods for incorporating memory.
Questions for authors
- Sections 2-3 are very unclear, the paper claims to contribute a “decision-theoretic foundation for cross-query coupling”, and “branch-relative continuation value”; what is established here? In the experiments/method section, it is unclear how this discussion relates to the proposed mechanism, where a policy trained with behavior cloning has a recurrent history.