- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces EMAG, a hierarchical memory-augmented policy for non-Markovian robot manipulation. EMAG stores and retrieves past captioned keyframes with a high-level VLM, and re-grounds it to the current scene using an affordance map. EMAG shows strong performance on 16 RoboMME tasks.
Critical strengths
- EMAG shows strong performance on RoboMME, outperforming the strongest reported learned baseline by approximately 13 percentage points.
- The experiments cover both simulation and real-world history-dependent manipulation tasks.
Critical weaknesses
- Writing and clarity: The method section includes many notations which makes it hard to follow, where it lacks critical information in the main paper. For example, it does not clearly specify the complete inputs to the low-level VLA policy, although it is modified from a standard pi0.5. Also the formulation is also tied to a specific observation setup, consisting of one front-view and one wrist-view. The experiment section provides insufficient details about the compared methods and oracle references, such as how the oracle signals are constructed and provided to the policy, making it difficult to solely clarify the contributions of EMAG.
- The paper includes some ablation studies, but lacks in-depth analysis aligned with the paper's central motivation. For example, it does not include why the spatial grounding mechanism is important for performance, nor the efficiency claim of selective retrieval.
- The paper argues existing methods “do not jointly retain explicit event semantics and the visual evidence”, however, controlled comparisons among caption-only, keyframe-only, and captioned-keyframe memories are missing.
Questions for authors
See weaknesses also.
- What is the additional inference cost introduced by the integration of high-level policy?
- Can the authors provide a controlled comparison with prior memory-based methods using the same high-level and low-level base models?