- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents NOCSFlow, a flow-matching framework that learns dense NOCS representations from a single monocular RGB image for category-level 9D pose estimation. A frozen MoGe-2 geometry encoder extracts implicit geometric features from the RGB image and object mask, which are injected into a pixel-space flow-matching generator through multi-layer patch-to-patch conditioning; the generator iteratively denoises a noise field into a per-pixel NOCS canonical coordinate field. The predicted field is supervised jointly by a per-pixel field loss and a pose-space loss backpropagated through a differentiable EPro-PnP solver, together with a scale regression term. At inference, the terminal field is decoded into the 9D pose through a single pass of weighted PnP. NOCSFlow outperforms prior methods on CAMERA25 and REAL275 and achieves strong zero-shot transfer on Wild6D.
Critical strengths
++ The design is clean and well motivated: a pretrained geometry encoder supplies implicit geometric priors, and the canonical field is trained under coupled supervision from direct field losses and pose-space gradients through a differentiable PnP module.
++ The method outperforms existing approaches on the evaluated benchmarks and generalizes well to Wild6D without fine-tuning, supporting the effectiveness of the proposed method.
Critical weaknesses
-- The paper does not include a failure case analysis. It would be helpful to provide qualitative failure examples and an analysis of typical error modes.
-- Code is not available for review, which limits reproducibility given the magnitude of the reported gains.
-- Figure 2 does not clearly convey the input pipeline: the resolutions of the image and mask, shapes of the features, and whether the network consumes the full image or a resized crop of the object region. Since these details affect both correspondence supervision and multi-object scaling, it would help to annotate them in the figure.
Questions for authors
-- Among the conditioning variants, cross-attention did not converge. Is this an optimization issue or a sign of mechanistic incompatibility with the flow-matching formulation? Some diagnosis would further justify the choice of additive patch-to-patch injection.
-- The geometry encoder is kept frozen throughout pose training. Have the authors compared against a fine-tuned variant? An ablation of this choice would clarify whether freezing is essential.
Dear Reviewer PQ2V,
Thank you again for your suggestions on the failure cases and architecture figure. In our rebuttal, we outlined how we plan to illustrate small-object failures and clarify the figure. We also followed up on your questions about cross-attention and the decision to freeze the geometry encoder. We would appreciate hearing whether our response addresses the points you raised, or if there is anything you would like us to explain more clearly in the revision.
Thank you for your time and thoughtful feedback.