- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DGA-VLA, which uses wrist-camera depth and visual servoing to correct grasp positions when VLA predicts gripper closing, without retraining VLA. It improves success rates by 12.0%, 8.4%, and 14.6% on RoboTwin, SimplerEnv, and real robots.
Critical strengths
Simple and practical. It can be directly added to existing VLAs without retraining.2. Good experiments. The method is tested on multiple benchmarks and real robots.3. Performance improvement. The real-world success rate improves from 26.7% to 41.3%.
Critical weaknesses
1.Limited novelty. The main idea is based on traditional depth-based visual servoing. 2. Manual calibration. Each object needs an expert demonstration to get the grasp anchor, which limits generalization. 3. Missing baselines. There is no direct comparison with traditional visual servoing methods. 4. Limited generalization. Real-world experiments only include three objects, without testing unseen objects, occlusion, or depth noise.
Questions for authors
-
What is the main novelty compared with traditional visual servoing?
-
Can this method work on unseen objects without grasp anchors?
-
How does it handle occlusion or multiple nearby objects?
-
Can the authors provide ablations on grasp anchors, depth noise, and calibration?
5.Can the authors compare with simple position correction or standard visual servoing?
2 comments
Rebuttal response
Thank you authors for providing feedbacks, my concerns are fully resolved. I have updated my scores.
We thank the reviewer for recognizing the simplicity, practical utility, and results across simulation and physical hardware.
1. Contribution and comparison with visual servoing (Q1 and Q5)
Methodological insight (Q1). As discussed in the Introduction and Related Work, our contribution is the collaboration between a frozen VLA and local visual feedback. This exploits their complementary strengths: task understanding and approach motion from the VLA, and precise grasp alignment from geometric feedback. To realize this collaboration, we design depth-based localization and geometric correction around the stage-specific characteristics of manipulation tasks and shortcomings in VLA grasp precision, drawing on a visual-servoing control law rather than adopting an existing complete algorithm.
Standard visual servoing (Q5). Accordingly, comparing with standard visual servoing requires specifying the grasp target, desired alignment, and coordination with the VLA. The control law alone leaves these choices open, and their design is a substantive part of our framework.
Simple position correction (Q5). For simple position correction, the paper already includes a comparison with PhysVLA on LIBERO. PhysVLA incorporates simple position corrections using privileged simulator states, providing a relevant baseline for this comparison.
2. Calibration and generalization (Q2)
DGA requires a grasp anchor to define the desired alignment. This reference can be shared across object instances with the same category and grasp affordance, and an existing library entry with similar object geometry and grasp configuration provides a candidate reference for a new object. Our RoboTwin evaluation includes within-category object variants, with anchors fixed during evaluation. When a new reference is needed, automatic demonstration-based calibration adds it to the library for future reuse. This procedure can use demonstrations already collected for VLA fine-tuning, keeping the additional preparation cost low.
3. Occlusion and nearby objects (Q3)
Nearby objects. DGA reduces interference through depth thresholding, a local region of interest, gripper masking, and connected-component filtering, then selects the candidate nearest to the grasp anchor. Crucially, the VLA's preceding motion has already brought the gripper close to the intended object, making local geometric extraction effective even in a scene containing multiple objects, such as the kitchen scene in LIBERO-Long Task 0.
Occlusion. The same collaboration helps with occlusion. When nearby objects obstruct a direct grasp, the VLA is responsible for selecting a graspable approach direction through its preceding motion. This brings the gripper and wrist camera close to the intended grasp region, where DGA uses local depth feedback to refine alignment before closure.
4. Grasp-anchor ablation and depth-noise evidence (Q4)
Grasp-anchor calibration. The grasp anchor defines the desired state for alignment. We therefore examine its construction by replacing demonstration-derived anchors with a default reference at the gripper center on the same eight RoboTwin tasks reported in the paper, retaining the other settings. Average task success drops to 23.4%, compared with 42.3% for the vanilla VLA and 54.3% for calibrated DGA, demonstrating the importance of calibrating an appropriate grasp reference.
Depth noise. Simulation uses depth from the simulator, while the real-robot experiments use measurements from the wrist-mounted stereo depth camera. As shown in the paper's Figure 3(d) and described in Section 4.3, these observations contain invalid returns and local measurement noise. DGA still improves real-robot success from 26.7% to 41.3%, providing direct evidence of effectiveness with actual sensor depth.