- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the ambiguity of 6D pose estimation for transparent objects, whose lack of stable surface texture makes single-frame RGB evidence unreliable due to refraction and background appearance. AuTO-Pose uses a short memory of previously decoded views to provide context for the current target window. It stores object-centered RoI features from decoded frames for retrieval before dense coordinate prediction and pose regression, and introduces symmetry-aware supervision for visually indistinguishable orientations. Overall, the method is clearly described and improves several non-BOP metrics on TRansPose, TOS-6D, and ClearPose.
Critical strengths
(1) The context flow is constrained. Current-frame queries use only RoI features, RGB, 2D coordinates, mask confidence, and temporal embeddings, without geometry derived from the current pose estimate. Geometric anchors come only from previously decoded views and are fused into the current RoI features through a residual connection. (2) The symmetry supervision accounts for unobservable rotations. For axially symmetric objects such as cups, tubes, and bottles, rotation supervision preserves only axis alignment in camera coordinates. Surface points are represented by axial height and radial distance, with ADD-S used for point matching. Removing symmetry handling reduces ADD(-S) on New BG from 87.32 to 58.74 and from 89.29 to 58.95. (3) Improvements appear across multiple metrics against strong baselines. On TRansPose, increases from 68.01 to 73.34, from 25.05 to 31.71, and IoU@50 from 38.55 to 45.03. On TOS-6D New BG, ADD(-S) improves from 80.31 with GDRNPP to 87.32. (4) The ablations help isolate the contribution of temporal context. With the same DINOv3 backbone, the single-frame variant achieves an ADD(-S) of 80.54 on New BG, close to GDRNPP's 80.31. Retaining cross-frame attention while removing the context memory raises the score to 82.58, and the full model reaches 87.32. Under the stricter metric, the score also increases from 87.04 for the single-frame variant to 89.29 for the full model.
Critical weaknesses
(1) Potential inconsistencies in metric calculation. In Tables 1 and 2, consistently equals the average of and . However, the official BOP average recall also includes , which is not reported. The symmetry ablation in Table 4 also deviates from this calculation. The average of 42.96 and 74.47 is 58.72, whereas the reported value is 53.93. In addition, GDR-Net reports identical values of 75.51 for and ADD(-S) on New BG, while Reflow6D reports 69.58 for both metrics on Long Seq. These values should be verified. (2) Confounding factors in the ablations and inconsistencies with the reported conclusions. The non-autoregressive variant uses a six-frame window, whereas the no-context variant uses a three-frame window. This prevents the isolated effect of the context memory from being assessed. On New BG, removing the context memory improves both and , while the single-frame variant achieves even higher scores. These results are not adequately discussed in the paper. Furthermore, the symmetry ablation removes both nearest-pose supervision and continuous-axis handling, making it difficult to attribute the performance drop solely to the proposed symmetry rule.
Questions for authors
(1) Insufficient clarity in context construction. In Eq. (4), is obtained from the predicted object-coordinate map, yet the paper states that the object coordinate system is defined by the cached pose. The relationship between these two components needs clarification. The method also does not explicitly explain how refraction, reflection, or attenuation is handled. Moreover, training anchors are constructed from perturbed ground-truth poses, whereas inference relies on the model's own previous predictions. The authors should analyze how this discrepancy affects error accumulation. (2) Insufficient evidence for some central claims. The novelty of introducing autoregression to 6D pose estimation is not fully established, as existing pose-tracking methods also use historical estimates. The real-time inference claim lacks supporting frame-rate, memory, and latency measurements. The metric difference between New BG and Long Seq cannot directly demonstrate reduced error accumulation because the two results come from different test distributions. Furthermore, Table 3 shows that AuTO-Pose underperforms IRPose on several metrics under semi-transparent occlusion and in liquid-filled scenes. The abstract's claim of consistently achieving state-of-the-art performance should therefore be revised. (3) Incomplete experimental details and dataset description. The method section does not clearly specify the pose, coordinate, mask, and symmetry losses, or whether test crops are obtained from ground-truth boxes or detector predictions. As a newly introduced dataset, TOS-6D also lacks key details, including the number of objects, sequence scale, annotation procedure, and data splits. In addition, the single-frame variant using the same DINOv3 backbone achieves an ADD(-S) of 80.54, close to GDRNPP's 80.31. The authors should provide single-frame baselines and closed-loop training comparisons under consistent training settings and fixed window lengths to distinguish the contributions of the backbone, context memory, and symmetry-aware supervision.