- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Ground2Pose, a training-free framework for generalizable 6D object pose estimation. It uses a single source–reference RGBD image pair and a text description, without requiring CAD models or task-specific training. The framework consists of language-guided object localization, pixel matching, and relative pose estimation. Experiments on four benchmarks show promising results, outperforming the other evaluated competitors.
Critical strengths
- The proposed method supports generalizable 6D object pose estimation without requiring CAD models, multiple reference views, or task-specific training, making it applicable to novel objects.
- The authors evaluate the method across four benchmarks, comparing it against several representative baselines. The presented approach achieves better performance, demonstrating the effectiveness of the training-free framework.
- The ablation studies show consistent improvements over standard rigid alignment and alternative robust estimators such as RANSAC, TEASER++, and SC2-PCR.
Critical weaknesses
- The technical contribution of this paper is a bit limited and incremental. The overall pipeline follows a relatively straightforward design: using an existing open-vocabulary object detector to detect the novel object and handling the subsequent object pose estimation via a point cloud registration module. Such a design is quite straightforward and has been used in previous work. For instance, [1] also uses an open-vocabulary object detector for object detection. Besides, the authors use LoFTR to build correspondences, which can be replaced with other advanced approaches, such as roma [2] or vggt-omega [3].
- The reliance on RGBD input significantly simplifies the object pose estimation problem, as depth information enables direct 3D correspondence construction and rigid registration. However, this assumption may limit its applicability in some scenarios where depth is noisy or unavailable.
- The authors list some powerful relevant methods in Table 1, such as FoundationPose, but a comparison with it is missing.
Overall, I am concerned that the technical novelty and contributions of this work may not meet the standards expected for publication at ICLR.
[1] Chen Zhao, Tong Zhang, Zheng Dang, and Mathieu Salzmann. "Pose without Guesses: Generalizable Object Pose Estimation From a Single Reference." International Journal of Computer Vision 134, no. 3 (2026): 136.
[2] Johan Edstedt, Qiyu Sun, Georg Bökman, Mårten Wadenbäck, and Michael Felsberg. "Roma: Robust dense feature matching." In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 19790-19800. IEEE, 2024.
[3] Jianyuan Wang, Minghao Chen, Shangzhan Zhang, Nikita Karaev, Johannes Schönberger, Patrick Labatut, Piotr Bojanowski, David Novotny, Andrea Vedaldi, and Christian Rupprecht. "VGGT-." arXiv preprint arXiv:2605.15195 (2026).
Questions for authors
Please refer to my concerns in Weaknesses
3 comments
Response to Reviewer y3kQ (Part 2/2)
3. Reliance on RGB-D Input, Sensor Depth Noise, and New RGB-Only Query Extension (GVS-PnP) (W2)
[W2]: The reliance on RGBD input significantly simplifies the object pose estimation problem... However, this assumption may limit its applicability in some scenarios where depth is noisy or unavailable.
We address both noisy depth and unavailable query depth with new quantitative experiments (Appendix K.2 & K.4):
- Why RGB-D is standard for CAD-free metric 6D pose: Without a 3D CAD model of known physical size or category-specific scale supervision, recovering metric 6D translation from a single reference view is inherently scale-ambiguous unless metric depth is observed at least in the anchor frame (the exact same RGB-D modality used by Oryon, Horyon, LatentFusion, One2Any, and FoundationPose in
Table 1). - Robustness to Noisy Sensor Depth (
Appendix K.2): To evaluate noisy RGB-D sensors, we injected multiplicative Gaussian depth noise into both anchor and query depth maps before 3D back-projection. Even at heavy 2.0% depth noise (exceeding commercial RealSense/Kinect sensor error at manipulation distances), ADD(S)-0.1d changes by only −2.04 (YCBV), −1.65 (NOCS), −2.44 (TOYL), and +0.96 (LM) (mean shift −1.29 points), demonstrating that GVS's residual trimming effectively absorbs sensor depth noise. - When Query Depth is Completely Unavailable — Preliminary RGB-Only Query Extension (
GVS-PnP,Appendix K.4): What if the query observation is RGB-only (no query sensor depth)? While naively feeding monocular predicted depth (e.g., ZoeDepth or Depth-Anything-V2) into 3D–3D SVD fails due to global monocular scale/affine drift (0.0%–7.4%), our GVS principle naturally extends to RGB-only queries by replacing 3D–3D SVD with 2D–3D PnP + 2D Reprojection Self-Verification (GVS-PnP) using only anchor depth:
| Query Modality & Method | YCBV | NOCS | TOYL | LM |
|---|---|---|---|---|
| Oryon (Full RGB-D Anchor & Query, Trained) | 11.40 | 23.30 | 22.90 | 7.20 |
| LatentFusion (Full RGB-D, Trained) | 24.40 | 18.70 | 54.60 | 22.80 |
| Ground2Pose w/ GVS-PnP (RGB-Only Query, No Query Depth) | 31.00 | 35.40 | 27.40 | 15.95 |
| Ground2Pose w/ 3D–3D GVS (Full RGB-D, Default) | 58.50 | 86.20 | 83.20 | 55.60 |
Remarkably, even without any query depth map, our training-free GVS-PnP extension achieves 31.00% on YCBV and 35.40% on NOCS, outperforming full RGB-D baselines such as Oryon (11.4% / 23.3%) and LatentFusion (24.4% / 18.7%)! This confirms that our decoupled self-verification paradigm is not restricted to 3D–3D RGB-D registration and extends cleanly to RGB-only query scenarios.
We hope these new experiments, RoMa ablations, and RGB-only query results address your concerns.
I thank the authors for their response. However, my concerns regarding the technical novelty and advantages over FoundationPose still exist.
The idea is straightforward, and the novelty is a bit limited. As I mentioned in my reviews, some open-vocabulary object detectors exist and work well. Besides, with the availability of powerful foundation models such as SAM2, open-vocabulary object detection does not seem to be a particularly challenging problem.
A direct comparison with FoundationPose is still missing. The proposed method also requires RGB-D inputs, similar to FoundationPose, with the key distinction being its reliance on a single reference view rather than multiple views. In this context, it is important to quantify how much performance is sacrificed in exchange for reducing the dependence on prior observations. If the performance degradation is substantial, it remains unclear whether the benefits of the proposed setup outweigh this trade-off.
Therefore, I have to keep my original rating.
Response to Reviewer y3kQ (Part 1/2)
We thank Reviewer y3kQ for recognizing the practical value of our CAD-free, single-anchor, training-free paradigm for novel objects and our consistent improvements across four benchmarks and multiple robust estimators. Below we address each concern in detail.
1. Technical Contribution, Architectural Insight, and New Literature (W1, W4)
We thank the reviewer for pointing out DVMNet++ ("Pose without Guesses", IJCV 2026) [1], RoMa (CVPR 2024) [2], and VGGT-Ω (2026) [3], all of which are now cited and discussed in
Section 2,Section 3.2, andAppendix A/K. Three key points distinguish our contribution:Appendix C.2 & H.6) that coupling or soft-reweighting 2D semantics with 3D geometry actually degrades pose accuracy (by up to −10.0 points), whereas a strictly decoupled, training-free pipeline with hard 3D correspondence self-verification (GVS) outperforms trained single-reference SOTA (beating One2Any by +8.78 points average and +21.60 points on cluttered NOCS, and beating Oryon/Horyon by +43.5 to +54.7 points).Table 2(Prior = Ours), all baselines (Oryon, LatentFusion, OnePoseviaGen, GigaPose, and One2Any inTable 15) are evaluated using our exact same Grounded-SAM masks, and even under 100% Ground-Truth Oracle masks (Prior = Oracle), they still trail Ground2Pose by 17.0 to 63.2 points. Thus, the performance leap comes from our match-then-self-verify formulation, not merely from using an off-the-shelf detector.Appendix K.3): Following your suggestion, we replaced LoFTR with RoMa [2] (roma_outdoor.pth) with zero changes to GVS (γ=0.7). As detailed in our Global Response (§1) and Response to JCkW (§2), RoMa + GVS achieves 40.7% / 77.0% / 30.0% on YCBV / NOCS / LM, still outperforming all priorTable 2baselines, and GVS boosts RoMa across all four datasets—including a massive +17.80-point gain on wide-baseline NOCS (59.16% → 76.96%) where RoMa's dense warp field produces silhouette outliers that corrupt plain Kabsch. We also discuss feed-forward 3D foundation models like VGGT-Ω [3] inSection 3.2as promising correspondence front-ends that naturally plug into our GVS backend.2. Positioning Relative to FoundationPose (W3)
As shown in
Table 1(tab:positioning), FoundationPose operates under a fundamentally different assumption regime:In contrast, our protocol provides only a single anchor RGB-D frame and a text prompt, with zero CAD models and zero per-object optimization. Note that in
Table 2we already evaluate GigaPose (which receives 3D CAD templates) and LatentFusion / OnePoseviaGen (which build neural/generative multi-view representations from the single anchor) to represent these paradigms under the single-anchor constraint. We have expandedSection 2andAppendix Ato make this regime boundary with FoundationPose explicit.