- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a multi-hypothesis generation-and-selection pipeline over coordinate systems for canonical object pose estimation. As defined in the paper, canonical object pose estimation takes a 3D point cloud as input and recovers the object's predefined canonical orientation in a way that is consistent across categories.
The method exploits object symmetry to obtain candidate geometric axes, from which coordinate-system hypotheses are constructed. A selection network with separate up and front heads (each a three-layer MLP) scores these hypotheses, and the highest-scoring one is chosen. A second network then performs orientation refinement, producing the final orientation of the object via a 9D rotation representation projected onto SO(3) with SVD.
Experiments validate the effectiveness of the proposed pipeline on canonical object pose estimation.
Critical strengths
S1. Leveraging the symmetry prior of real-world objects. The observation that most real-world objects are (nearly) symmetric, and the idea of exploiting this, is a meaningful and promising direction. In particular, it is a well-suited approach for finding canonical object poses.
S2. Performance gains over baselines (Tables 1 and 2) and thorough ablations (Tables 4, 5, and 6). The method shows clear improvements over the baselines on the SO(3) subset. In addition, the ablations cover/verify the effectiveness of the proposed components (the multi-stage pipeline, the decoupled up/front heads, and the refinement network).
Critical weaknesses
W1. Limited technical novelty. The proposed networks that generate hypotheses and select the highest-scoring one have been proposed many times before. In particular, the following closely related works on the same task as follows. Please cite these works, clarify the differences:
- Symmetry-Robust 3D Orientation Estimation (Scarvelis et al., ICML 2025).
- Upright-Net: Learning Upright Orientation for 3D Point Cloud (Pang et al., CVPR 2022).
W2. Computational inefficiency of discrete hypotheses. Every hypothesis requires a separate forward pass through the selection network (24 passes per object), in addition to the symmetry search in Stage 1 (20K sampled directions). As the hypothesis/search space grows, the cost of the up/front heads grows with it, which is a structural limitation. A runtime comparison against the baselines would be helpful.
W3. Insufficient description of how the benchmark was built. To evaluate the proposed baseline, the paper uses a new 3D benchmark obtained by revising CanoVerse. Objects are grouped into subsets at the instance level, but no statistics are provided for these subsets. The number of objects in each (test) subset, whether the grouping is done per category or per instance, and how the relabeling was carried out are not sufficiently described.
W4. Insufficient validation of the symmetry-based pose estimator. The out-of-distribution evaluation is limited: OmniObject3D is evaluated without the subset split, and the real-scan set contains only 24 objects.
Furthermore, there is no explicit evaluation on categories unseen during training, nor on partially observed or occluded objects.
W5. Evaluation tailored to the proposed method. The proposed method is trained with knowledge of the subset definitions — for Up-only and Front-only objects it optimizes a single-axis error.
Image-based baselines in Table 1 such as Orient Anything (V1/V2), however, are evaluated without knowing the subset definitions and the paper's labeling convention, which appears to make the setting overly favorable to the proposed method. Please clarify whether they were also trained with the same subset-aware supervision.
W6. Unclear extensibility of the simple baseline. The method is a simple baseline that generates multiple symmetry-based candidates, but how it can be extended further is unclear. At present it reads more like one particular "approach" to canonical object pose estimation than a baseline the community can build on.
Minor 1. The term "object pose estimation" may be confused with the line of work on object pose estimation from 2D images. Please state the task more specifically, e.g., "3D point cloud-based canonical object pose estimation" in title or abstract.
Minor 2. There are no formally defined equations. The symmetry transformations, the Chamfer-based fitness, the hypothesis labels, and the training losses are described only in words.
Questions for authors
W1. How does the proposed pipeline differ from Scarvelis et al. (ICML 2025) and Upright-Net (CVPR 2022), and how does it compare with them on the same data? W2. A runtime comparison with the baselines would be appreciated. W3. Please provide a detailed description of the benchmark (subset statistics and the relabeling procedure). W4. Please provide generalization experiments that demonstrate the advantage of a symmetry-based model (e.g., unseen categories, partial/occluded inputs). W5. Please address the concern that the evaluation protocol is tailored to the proposed method. W6. Please discuss how this simple baseline could be extended.