- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies forward mental rotation in vision-language models (VLMs). The task requires predicting an object’s unseen pose after a specified rotation. The paper first conducts diagnostic experiments on frozen visual features and learned transformation operators. Then, a map–rotate–match supervision framework (MaRR) is proposed, which tracks object-specific geometric cues through a shared transformation procedure. In order to train VLMs, a training data generation process is developed in the CAD field that includes a strong teacher model. Experiments are conducted on the constructed evaluation set and open-source dataset.
Critical strengths
- The task is clearly defined. Fixing the camera and world frame helps distinguish commanded object rotation from viewpoint changes and object recognition. The object-disjoint splits and same-object distractors provide useful controls against simple identity matching.
- The paper conducts diagnostic experiments to reveal task characteristics, which are used to guide the construction of training data.
Critical weaknesses
- The paper studies the forward mental rotation task, but does not analyze the connection and differences between this task and related tasks in existing spatial understanding. Meanwhile, the paper mainly construct a dataset in the CAD field, but does not specify the significance of this task for the field.
- The paper lacks innovation and only constructs an SFT dataset, and then trains the Base model (Qwen3.5-4B).
- Severe degradation on a public rotation benchmark. Table 2 shows that MaRR-SFT drops from 52.3 to 29.4 on SpinBench Forward, and from 23.5 to 20.0 on SRBench Hard.
- The Related Work section mainly introduces spatial understanding methods, without involving research on forward object rotation.
- Writing and formatting issues reduce clarity.
Questions for authors
See Weaknesses.