- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MatchingPolicy, a correspondence-aware framework for in-context imitation learning that enables robot manipulation across different objects and scenes. It decouples semantic correspondence extraction from action prediction and proposes a graph-based diffusion policy conditioned on explicit correspondences. Extensive experiments on RLBench and real-world manipulation tasks demonstrate strong generalization to unseen tasks and objects.
Critical strengths
- The paper addresses an important and challenging problem in robotic manipulation, particularly few-shot generalization to unseen objects and scenarios.
- The idea of decoupling correspondence extraction from action prediction is intuitive and interesting.
- The method achieves strong performance on both simulation and real-world tasks, demonstrating its effectiveness across different manipulation scenarios.
Critical weaknesses
- While the paper claims cross-category generalization, Table 3 primarily evaluates layout and shape variations, whereas cross-category transfer is demonstrated mainly through a qualitative example in Figure 9. I would like to see more systematic quantitative evaluations across different object categories.
- Could the authors discuss whether MatchingPolicy could be extended to other settings (e.g., [R1]), where demonstrations of the target task are unavailable? What limitations or modifications would be required?
[R1] Exploring the Limits of Vision-Language-Action Manipulation in Cross-task Generalization. NeurIPS 2025
Questions for authors
See weakness
2 comments
Thank you for the authors' response. After carefully reading the authors' response and the other reviewers' comments, I think most of my concerns have been addressed. Therefore, I decide to maintain my rating of Weak Accept. Good luck!
We have added quantitative evaluations of MatchingPolicy on four cross-category transfer tasks in RLBench. For each task, the object category used during evaluation differs from that in the demonstrations. Each transfer success rate is evaluated over 100 trials, while the success rates on the original object categories are taken from the
MPresults in Table. We use VLM to assist in extracting local semantic correspondences across object categories.The videos of cross-category tasks are available on our anonymous website.
W2: Extension to settings without target-task demonstrations.
MatchingPolicy could be extended to settings without target-task demonstrations. As shown in W1, MatchingPolicy can transfer interactions across object categories, suggesting the feasibility of reusing demonstrations from related tasks. Specifically, we could construct a general demonstration database covering diverse tasks and objects. Given target instruction and observation, a VLM could retrieve demonstrations with transferable interaction patterns and identify corresponding functional parts. MatchingPolicy could then leverage these correspondences to transfer the retrieved interactions to the target scene.
Limitation: This extension relies on the availability of relevant interaction patterns in the database, as MatchingPolicy cannot generate fundamentally novel interactions without suitable demonstrations.
We will discuss this extension and its limitations in the revised manuscript.
[1] Zhou et al. Exploring the Limits of Vision-Language-Action Manipulation in Cross-task Generalization. NeurIPS 2025.