- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses the lack of explicit object-state structure in VLA policies. ObjectBinder-VLA predicts object locations, absence, and visibility for each camera view while retaining global visual-language features. Training uses segmentation pseudo-labels and set matching for exchangeable instances. An Object Dynamics Model predicts future object distributions from current inputs. Detached future-state tokens then condition the action expert. The main strength is an inspectable interface that represents several distinct aspects of object state. However, future prediction lacks quantitative validation, and the matched control gains are small. The final 50K model reaches 98.10% on Original LIBERO. Reported success is 74.61% at the episode level on LIBERO-Plus and 81.2% across six RoboTwin tasks. At a matched 30K budget, the full model improves LIBERO success from 97.25% to 97.55%. Thus, full-system performance is promising, but the added modules' benefit to control remains uncertain.
Critical strengths
-
Clear object-state semantics. Localization, absence, and visibility have separate outputs. Set matching handles exchangeable targets, while retained global features preserve broader visual context.
-
Useful current-state diagnostics. The Binder is evaluated for localization, visibility, absence, and multiplicity against teacher references. Weak results for small wrist-view objects are also disclosed.
-
Broad benchmark coverage. Evaluation includes complete Original LIBERO and LIBERO-Plus protocols, plus six RoboTwin tasks. The paper distinguishes aggregation methods and acknowledges limits of its ablations. The evaluation range is broad enough.
Critical weaknesses
-
Future prediction lacks quantitative validation. Current Binder metrics and qualitative examples do not establish whether future distributions outperform copying the current state. This is central to the proposed action-conditioning interface.
-
The matched control gain is inconclusive. The 30K improvement amounts to six extra successes out of 2,000. The authors acknowledge this uncertainty, but independent training repeats are still needed to establish module benefit.
-
RoboTwin averages are not directly comparable. The summary includes published results with different task sets and data budgets. The protocol caveat is appropriate, but combining these averages still invites an unsupported ranking.
Questions for authors
I still have three questions:
-
Does future prediction beat a current-state persistence baseline on independent trajectories, including moving and static objects separately?
-
How stable is the gain over the matched 30K baseline across independent training seeds?
-
Can external RoboTwin results be presented separately, with task sets and training-data budgets clearly stated?