- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors propose the task of orientation grounding, which predicts an object's 6D orientation and axial symmetry in the 3D grounding task. To study this task, the authors introduce ReferOri, a referring orientation-grounding dataset. Then the authors present OG-VLM to solve this task. The experiments demonstrate the consistent performance gain on various benchmarks.
Critical strengths
- The proposed ReferOri dataset provides orientation and symmetry annotations for both single-view and multi-views. The proposed data generation pipeline could be potentially used for other data domain.
Critical weaknesses
- The proposed task and methods have limited novelty. In terms of the task, predicting object orientation is not new in 3D grounding. As described in Appendix C1, several existing methods, like SpatialReasoner and VG-LLM, already predict object orientations using different representations. It is not clear why existing orientation representations are not sufficient, and the proposed formulation in Sec. 3.1 worth exploring. In terms of the method, special tokens and geometric losses in Sec. 3.3 are not purely novel. For example, Grounded 3D-LLM introduces special referent tokens for 3D grounding, while VGR [A] uses special spatial tokens and an auxiliary geometric loss with an MLP prediction head. The proposed method extends these designs to the new task, but the novelty appear limited.
- The quality of the annotations in ReferOri depends heavily on the reconstruction and orientation estimation pipeline (e.g., SAM3D). For single-view data, only 5 rounds of 100 samples are manually checked. To verify the effectiveness of the proposed pipeline, the authors should consider compare against some independently established ground truth.
[A] Wang, Jiacong, et al. "VGR: Visual grounded reasoning." ICLR 2026.
Questions for authors
- Based on weakness 1, how does the proposed object-centric orientation differ from existing orientation representations? Could the authors provide a comparison to demonstrate why the formulated representation is necessary?
- Based on weakness 1, could the authors further clarify the novelty of the model design in sec. 3.3, compared against the existing work?
- Based on weakness 2, could the authors provide some analysis on the annotation pipeline against some datasets with ground truth annotations? Also, how good is the annotation pipeline when handling the occluded objects or symmetric objects where the orientation is hard to predict?
- For the baselines, could the authors also finetune those models using the same ReferOri data for a fair comparison? That would help distinguish the improvements from additional supervision and the proposed architecture.
- Could the authors provide an inference time computation comparison against the baselines (e.g. Spatial Reasoner and VG-LLM in Tab. 1)? Also, the authors should consider do computation analysis on the annotation pipeline (e.g., how long does it take to generate orientation for single-view and multi-views?). This would benefit other research which may potentially apply the pipeline on other datasets.