- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes RoleBind, a training-time auxiliary supervision that explicitly binds task roles (manipulated / target object) to their corresponding visual instances via a contrastive loss, while leaving the base VLA's architecture and inference unchanged. On LIBERO it raises StarVLA-OFT from 98.00% to 98.55% and StarVLA-π from 97.50% to 98.30%. The method requires role labels and instance masks only during training.
Critical strengths
-
By directly supervising the correspondence between task semantics and physical entities, RoleBind improves VLA accuracy across two different VLA models.
-
The additional supervision is used only during training and has zero impact on inference: the binding branch, projectors, and masks are all removed at deployment, with no segmentation model and no change to the input–output interface.
Critical weaknesses
-
Lack of real-world experiments, there is a huge sim to real gap between the real world and simulation, and experiments must be conducted on real robots to verify the effectiveness of your method.
-
The paper compares only against its own base model and lacks comparisons with related auxiliary-supervision baselines under matched training budgets. And there are many formatting issues with the article, e.g., in Tables 2 and 3 the success-rate values are not aligned in decimal places (98 vs 98.55, 75 vs 75.83); please correct this in the final version.
Questions for authors
-
Only two static roles (manipulated / target object) are modeled, and evaluation is limited to relatively simple tabletop tasks. In long-horizon, multi-object datasets such as BEHAVIOR-1K, activities like "BakingSugarCookies" involve ingredients, a mixer, and an oven whose roles change across stages. How can your method handle this problem?
-
On real-robot data, masks and instance-level information needs manual annotation and additional detection/segmentation, which cannot be obtained by simulator replay. How do you consider this additional cost?