- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces SGOP3D, which reconstructs an object point cloud in a complex scene using 2 RGB-D images. Input: 2 images + a text prompt Pipeline: 1. detect whether the object is in the image and output a bounding box -> 2. target the object & correspond the object between 2 images, and only "trusted" matches are admitted -> 3. based on the measured point cloud, predict the full point cloud -> 4. grab the object. Output: object's point cloud + position for grasping
Critical strengths
- It is a very important research question for the robot to identify what the target object is and where it is.
- Interesting trusted cross-view instance anchoring: it is important to let the robot know which object is the right one to pick up instead of picking up the wrong object.
Critical weaknesses
- The actual inputs are 2 images with their depth, intrinsic, and extrinsic information. Please state this explicitly in the abstract. The baselines were not given the same depth and calibration, which seems unfair and should be added to the main paper instead of being stated in the appendix.
- Comparison is insufficient. Currently, it only has comparisons with scene-level reconstructors in Table 1; it would be better to add:
- Comparison with object reconstruction methods such as Trellis or Hunyuan3D with depth-based scale/pose alignment;
- Comparison with other point cloud completion networks such as PoinTr and AdaPoinTr.
- Comparison with SceneComplete, which is shown in the supplementary video as related work, is neither cited nor compared in the paper, although it addresses a closely related task.
- In Table 2, "Dual + consensus" compared to "Geometry only" is a little better on false acceptance but a lot worse on Present-target acceptance, and 10.54% become unknown rate, which means the fine-tuned VLM is not significantly better than "Geometry only". Adding an ablation of "Geometry only + consensus".
- Since contact points are restricted to the measured point cloud in the configuration, why is the gap in Table F2 between C1 76% and SGOP3D 96% so large? Please provide a failure analysis to show how much of the gain comes from completion itself.
- Please clarify how the CAD ground-truth models are obtained and their accuracy, especially for natural or deformable objects, whose shapes may differ.
- The supplementary video stated, "All methods share inputs and calibration," which is different than what really happens.
Questions for authors
See weakness.