- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies 6-DoF grasping of targets specified by text or visual queries in cluttered scenes. SAGE-Grasp combines frozen SAM-CLP semantic priors with full scene 3D geometric features, and predicts target related grasps through a hybrid expert grasping head consisting of query aware candidate sampling, CMSA, and Gumbel-routed MoE. The model combines text, visual, and zero query training to simultaneously support target conditional grasping and task independent grasping. The validation scope is a fixed set of 88 object description vocabulary and visual queries within the scene, which does not yet include real robot experiments.
Critical strengths
- In Table 1, text queries on Seen HR@1 From the strongest listed baseline of 12.75% to 37.04%, SGSR increased from 19.21% to 43.51%. There have also been improvements on Similar and Novel. CF@1 Simultaneously improving indicates that the results involve the geometric feasibility of grasping candidates, rather than just target localization.
- Unified support for target conditions and task independent prediction has systematic value. The same model supports text, in scene vision, and zero query. Under zero query, 60.50, 51.99, and 23.16 APs are obtained on three partitions. The author also explicitly discloses the boundaries of fixed vocabulary, cache apriori, and lack of robot execution verification, which helps to accurately understand the conclusions that experiments can support.
Critical weaknesses
W1. Compared to cascading baselines, this article simultaneously changes the scene context, candidate sampling, semantic condition training, and prediction head, making it difficult to determine where the main benefits come from. In Table 3, CMSA brings benefits on Seen HR@1 The gain is only 0.49 percentage points, while the SGSR gain brought by Novel is 0.52 percentage points. In addition, the control without MoE lacks capacity matching explanation, making it difficult to distinguish the roles of expert routing and additional parameter quantities. This limits the experimental support for the two main architectural contributions.
W2. Lack of real machine grasp experiments, and the verification of physical feasibility is still limited to offline proxy indicators. The existing results are based on GraspNet data and analysis of collision and force closure assessments, and the performance of predicted grasping on real robots has not been validated yet. Due to the emphasis on the physical feasibility in cluttered scenes and the role of preserving context in reducing collisions, whether real perception errors, calibration errors, and execution deviations will weaken these advantages will directly affect their practical value. The authors disclosed the limitations of the lack of robot execution validation in Section 5, but currently there is still a lack of evidence linking offline metrics improvement to actual target grasping success rates.
Questions for authors
Q1. Does the cascading baseline receive a target clipped point cloud or a complete scene? How to achieve target screening and confidence ranking? Can you provide a target screening comparison that uses the same geometric backbone, the same SAM-CLIP prior, and preserves all scene inputs to clarify the benefits of the unified prediction framework itself?
Q2. Does "w/o CMSA" simultaneously remove gating supervision and contrast loss? What alternative head is used for 'w/o MoE' and does the number of parameters match?
Q3. Under the same backbone and training budget, how much scene level AP can a model trained only with zero queries achieve?
Q4. The model methods compared in Table 2 are outdated, and some new methods have not been compared yet (such as EconomicGrasp, etc.)
2 comments
Additional Real-World Validation and Clarification of Scene-Level Performance.
Thank you for your continued feedback. We have further strengthened the manuscript by adding real-world robotic experiments and clarifying the evaluation results in Table 2.
Real-world validation. We have conducted additional physical grasping experiments using a Flexiv robotic manipulator equipped with an Intel RealSense D405 RGB-D camera and a parallel-jaw gripper. Four objects with different geometric properties were evaluated, with 10 trials per object. SAGE-Grasp achieved success rates of 100% on the banana, 80% on the strawberry, 100% on the medicine box, and 100% on the zebra-shaped toy, yielding an overall success rate of 95.0% (38/40). The experimental setup, quantitative results, and qualitative grasping sequences are provided in Appendix G. These additional experiments provide direct physical evidence of the feasibility of SAGE-Grasp in real-world robotic execution.
Scene-level evaluation (Table 2). We acknowledge that SAGE-Grasp currently underperforms the two additional baselines in scene-level grasp detection. However, the primary objective of SAGE-Grasp is not to surpass specialized task-agnostic detectors in scene-level AP, but to integrate target-conditioned grasp prediction with full-scene geometric reasoning within a unified framework, while retaining scene-level grasping capability. This distinction reflects the central motivation of SAGE-Grasp: enabling semantic target-conditioned grasping without abandoning general scene-level grasp prediction.
We appreciate the reviewer's feedback, which has helped us strengthen the physical evaluation and clarify the objectives and limitations of the proposed framework.
I thank the authors for their response. However, my concerns regarding the real-world robot experiments and the performance evaluation in Table 2 have not been satisfactorily addressed. Therefore, I will maintain my original score.