- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
-
Motion-MLLM adds IMU motion data to a VLM to improve spatial understanding.
-
It uses motion-guided keyframe selection and asymmetric cross-attention to combine visual and motion features.
-
Evaluation covers five benchmarks with synthetic IMU and 120 questions over six real-IMU sequences, reporting improved accuracy and lower latency.
Critical strengths
-
Meaningful gains: VSI-Bench improves from 49.0 to 58.2 over the matched-protocol VGGT-only baseline, particularly on distance and room-size estimation.
-
Useful ablations: Encoder comparisons, motion corruption, scale interventions, and sensor perturbations provide evidence that the model uses aligned motion information.
Critical weaknesses
-
Limited real-data validation: A.4 does not explain how camera trajectories yield object-distance and room-size ground truth. The six TUM-VI room sequences also offer limited environmental diversity, weakening the evidence for broad real-world transfer.
-
Unclear system dependencies and costs: VGGT feature reuse and latency accounting are insufficiently specified. ScanRefer [email protected] rises from 19.6 to 55.3 with proposal refinement, so the role of external 3D proposals must be distinguished from the model’s own grounding ability.
Questions for authors
-
How are TUM-VI distance and room-size answers measured and verified? Do all six sequences depict the same room?
-
Which frames are jointly processed by VGGT, and are features recomputed or cached? What operations and hardware are included in latency measurements?
-
What external 3D information generates the ScanRefer proposals and Scan2Cap coordinates? Where are reference camera poses used?
-
How is the motion gate initialized? Does Table 13 actually block cross-frame relay, given that each updated motion token can already contain other frames’ visual information?
4 comments
Kind reminder before the discussion period closes
Dear Reviewer,
As the discussion deadline approaches, we would be very grateful for any response to our rebuttal. We have responeded each of your points and submitted a revised paper version with changes highlighted, including several new experiments conducted for this response, and we remain ready to clarify anything that is still unclear.
Even a brief note on whether our rebuttal has resolved your concerns would be valuable to us, and we would gladly answer any remaining questions in the time available.
Thank you very much for your time and consideration.
Gentle follow-up as the discussion period closes
Dear Reviewer,
Thank you again for your review. We wanted to follow up as the discussion period closes tomorrow. We have posted a detailed response addressing each of your questions, including the TUM-VI ground truth, VGGT feature reuse, latency accounting, the role of external proposals, and the relay intervention. A revised paper with all changes highlighted is also available.
We would be grateful for any feedback at your convenience.
Thank you for your time.
Final follow-up before the discussion period closes
Dear Reviewer,
As the discussion period ends today, we wanted to reach out one last time. We would greatly appreciate any feedback on whether our response and revised paper address your concerns. We are happy to clarify anything further.
Thank you for your time.
Kindly requesting for feedback on our rebuttal
Dear Reviewer,
Thank you again for your detailed review. We have posted a response addressing each question: the TUM-VI ground-truth procedure and the shared room, VGGT feature reuse and latency accounting (with a component breakdown in Tab. 6), the role of external proposals in ScanRefer and Scan2Cap, the motion gate initialization, and the scope of the relay intervention (Tab. 14). A revised paper has been uploaded with all changes highlighted in red.
We would be grateful to know whether these address your concerns, in particular the real-data validation and the system dependencies. If anything remains unclear, we would welcome further discussion.
As there are only a few days remaining in the discussion period, we would appreciate any additional comments at your earliest convenience.
Thank you for your time and consideration.