- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether panoramic VLMs can correctly update their answers when the observer’s heading changes. It introduces a yaw-orbit benchmark that distinguishes questions with invariant answers from those requiring answers to be regenerated from scene geometry. The proposed OrbitAlign combines orbit SFT, orbit-grouped GRPO, and FCO, substantially improving answer correctness in the current reference frame across three backbone models.
Critical strengths
- The evaluation distinguishes answer consistency from correctness under reference-frame changes. The changed-label and full-orbit metrics reveal errors that view-averaged accuracy alone cannot capture, providing a valuable diagnostic approach for panoramic spatial reasoning.
- The complete training framework achieves substantial improvements across three backbone models, demonstrating its effectiveness.
Critical weaknesses
- In Table 4, adding FCO to orbit-grouped GRPO increases changed-label accuracy from 51.24 to 53.17, but decreases E1 robust accuracy from 45.87 to 45.04.
- The evaluation is limited to the selected relative-position questions and does not demonstrate the fine-tuned models’ generalization to more diverse inputs and broader panoramic question-answering tasks.
Questions for authors
See weekness
3 comments
Thank you to the author for replying to my comments. It has resolved some of my questions. I still maintain my original score.
Thank you for your thoughtful feedback and reconsideration. We appreciate your time and are pleased that our rebuttal addressed your concerns.
We sincerely thank the reviewer for their constructive feedback and valuable suggestions. We address each concern below.
FCO's E1 trade-off.
Broader panoramic QA.
Table 2: Six-task PCSR-Bench comparison on Qwen2.5-VL-7B. All rows use the 7,689 released test questions, shared inference settings, and a reconstructed relaxed scorer; the exact official scorer is unavailable. Base is our evaluation of the untrained model.RDis: Relative Distance; RDir: Relative direction CDC: directional chains; ERR: egocentric rotation; PRA: perspective re-anchoring. Avg. is the unweighted six-task mean. Bold marks the best of these rows; values are percentages.
[1] Y. Chen, W. Wong, J. Li, I. Patras, and X. Zheng. Beyond localization: A comprehensive benchmark of perspective-conditioned spatial reasoning in MLLMs from omnidirectional images. In Proceedings of the 34th ACM International Conference on Multimedia, MM ’26.