- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AxisPose++, a reference-anchored framework for estimating the 3D rotation of unseen objects from a single RGB reference. Unlike prior methods that use the reference as visual evidence, AxisPose++ treats it as a coordinate anchor and reformulates the task as transporting the reference’s tri-axis structure to the target view. The method works in three stages: it first builds a coordinate-aware condition from the reference, then uses a multi-scale injection U-Net to predict both dense tri-axis likelihood fields and global axis geometry in the target view, and finally recovers the rotation by back-projecting axis hypotheses and selecting the most geometrically consistent one. Experimental results show that AxisPose++ clearly outperforms OrienPose on the ShapeNet benchmark with strong unseen-category generalization. It also transfers well to real-world benchmarks (NAVI and Objectron) without fine-tuning, while running much faster than OrienPose.
Critical strengths
++ This paper extends AxisPose, which estimates rotation by regressing a tri-axis coordinate frame, to the problem of generalizable rotation estimation from a single RGB reference. The proposed method is well-designed and effective, and the empirical results are convincing.
++ The authors provide an anonymous repository with code, training configurations, and pretrained weights, which is a plus for reproducibility.
Critical weaknesses
-- The proposed method performs somewhat worse than existing methods on the real-world benchmarks NAVI and Objectron. It would be helpful if the authors could analyze the reasons behind this gap, for example, by including some case-level discussions. In addition, the qualitative examples in Fig. 4 mostly showcase successful cases. A few examples where the method underperforms competing baselines would make the evaluation more informative.
-- Given that the method relies on a specifically defined reference coordinate frame, if the coordinate system of the reference image is altered at test time, can the relative rotation between the query and the reference still be accurately predicted? Specifically, how does altering the reference coordinate frame affect the prediction performance on the query?
Questions for authors
See above.
6 comments
Regarding the effect of altering the reference coordinate frame at test time, could you quantify the resulting changes in the evaluation metrics and provide representative visualizations for a few samples?
Thank you for the follow-up. We have added a controlled evaluation of test-time reference frame changes to Appendix A.8 of the revised manuscript. Table 3 reports the quantitative results, and Figure 14 shows four reference-target pairs involving different objects. We also released the evaluation script and instructions on the anonymous GitHub repository for reproducing both the metrics and the visualizations.
We use the same randomly sampled 100 ShapeNet reference-target pairs in all four conditions, keeping both RGB images, camera intrinsics, and translations fixed. For each pair, we sample a 3D rotation axis and reuse it at 0°, 15°, 30°, and 60°. For a frame change , we update the reference rotation to and reproject its three axes. The target annotation transforms consistently to , so the ground-truth relative rotation remains . We rerun the full inference pipeline for each condition and express the predicted target rotation in the original object frame before computing angular error.
| Frame change | Acc@30 (%) ↑ | Δ Acc@30 (pp) | Median angular error (°) ↓ | Δ median error (°) |
|---|---|---|---|---|
| 0° | 69.0 | — | 10.20 | — |
| 15° | 71.0 | +2.0 | 19.44 | +9.24 |
| 30° | 43.0 | −26.0 | 31.62 | +21.42 |
| 60° | 14.0 | −55.0 | 52.96 | +42.76 |
At 15°, there is a net gain of two pairs below the 30° threshold, while the median angular error increases by 9.24°. At 30° and 60°, both metrics degrade substantially. Figure 14 in the Appendix shows that individual pairs respond differently. The upper-right example degrades from 9.17° to 51.32°, the lower-left example stays below 30° in all four conditions, and the lower-right example improves from 46.56° to 12.64° at 60°. The aggregate degradation therefore coexists with substantial variation across individual pairs.
AxisPose++ uses the posed reference to make the object coordinate convention explicit and transports its tri-axis to the target view as geometric evidence for rotation recovery. When the object frame is redefined by , the desired target rotation changes from to , while the RGB image pair and the physical reference-to-target rotation remain unchanged. Because the target appearance alone cannot determine the new axis convention, the estimator must recover it from the reference pose and projected tri-axis and carry it into the target prediction. Under a consistent object-frame convention, associations between appearance and axis orientation learned during training can support this transfer. A test-time redefinition changes those associations while leaving the visual evidence unchanged, requiring the predicted rotation to transform with the supplied reference frame. AxisPose++ does not explicitly enforce this equivariance, and the degradation observed at larger frame changes in Appendix A.8 shows that the learned transport can deviate from the expected transformation. The main benchmarks and component ablations still support the core contribution: using an explicit reference tri-axis to anchor rotation estimation for unseen objects under a consistent object-frame convention. The new experiment clarifies the scope of that claim by identifying sensitivity to arbitrary test-time redefinitions as a limitation of the current estimator.
Response to Reviewer oqUg
We sincerely thank the reviewer for the encouraging assessment and valuable suggestions. We particularly appreciate the recognition of our reference-anchored formulation, the effectiveness of the proposed method, the experimental evidence, and our efforts toward reproducibility through the anonymous code release. To be honest, we feel GENUINELY HONORED and fortunate that the effort we have devoted to this work has been understood and appreciated. We also acknowledge the concerns regarding performance gaps on real-world benchmarks and the influence of reference-coordinate changes on prediction accuracy. These are important considerations for understanding the applicability and limitations of AxisPose++. We provide detailed analyses and clarifications addressing both concerns below:
Q1. Real-world Performance and Failure Analysis. We thank the reviewer for this constructive suggestion. We acknowledge that AxisPose++ does not consistently outperform competing methods on NAVI and Objectron, with particularly noticeable performance gaps in categories such as Cup and Chair on Objectron. These limitations may arise from object symmetry, weak texture, and occlusion, which introduce ambiguity in projected axis directions, while substantial intra-category shape variations further challenge reference-anchored coordinate prediction. Although TACB and HAAS generate and evaluate multiple rotation hypotheses, they cannot fully resolve such ambiguities when discriminative visual cues are insufficient.
To address this concern, we have extended the Failure Case Analysis with four representative failure examples in Fig. 8 of the revised manuscript. These cases illustrate incorrect hypothesis selection under orientation ambiguity, missing correct candidates under severe appearance degradation, and inaccurate axis predictions caused by weak directional cues. The accompanying discussion explicitly analyzes these failure mechanisms and highlights the remaining limitations of AxisPose++.
Q2. Robustness to Reference Coordinate Changes. We thank the reviewer for this insightful question. We would like to clarify that AxisPose++ uses the posed reference to establish an explicit object-coordinate convention, rather than assuming a particular fixed coordinate orientation. Geometrically, a consistent redefinition of the object coordinate frame does not alter the relative rotation between the reference and query.
Specifically, for a coordinate-frame rotation Q∈SO(3), the reference and target rotations transform as Rr′=RrQ⊤ and Rt′=RtQ⊤. Their relative rotation therefore remains unchanged:
Rt′(Rr′)⊤=RtRr⊤.
In AxisPose++, the reference pose and projected tri-axis jointly define the coordinate anchor. Hence, any coordinate-frame redefinition must consistently update both representations. However, while the underlying relative rotation is geometrically invariant, exact equivariance of the learned network to arbitrary coordinate-frame changes is not explicitly enforced. Our current evaluation assumes a consistently defined reference coordinate frame. We have clarified this distinction and the corresponding applicability assumptions in the revised manuscript.