- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper combines single-turn and multi-turn spatial question-answering data, keeps every target in its source-native answer format, preserves each answer's preceding observations and interaction history, and normalizes and re-weights the training losses of the supervision families to improve performance across spatial benchmarks; a separate inference-time frame-selection policy is evaluated on OVO-S.
Critical strengths
Two critical strengths are listed below.
-
The comparison in Tables 9–10 keeps the training data, histories, and budget fixed. Giving categorical, numerical, and trajectory supervision equal total loss weights improves on the natural-turn-weighting baseline, which already averages losses within each answer, across all three benchmarks and each of three paired seeds. This supports a concrete benefit from the chosen supervision weights.
-
The paper first compares the base and trained models under the same observations, then changes frame selection while keeping the trained model fixed. The two OVO-S gains are 4.91 and 4.09 points, respectively. This helps distinguish improvements from training from those obtained by selecting more suitable observations.
Critical weaknesses
Three critical weaknesses are listed below.
-
The gains after joint training do not by themselves establish the cross-interface transfer suggested by the title and keywords, although the paper itself refrains from attributing the joint gain to a single mechanism. The full model already receives categorical, numerical, and temporal supervision, including 2,545 single-turn numerical examples assigned one third of the total loss weight. Without a comparison that removes this group, improved numerical performance could reflect direct supervision rather than help from other tasks.
-
The cyclic-shift comparison changes both turn order and the history available for each answer, as Appendix D.5 acknowledges. Some questions may lose earlier observations needed to answer them. This supports preserving valid histories, but does not establish an advantage over separate training examples that retain the same complete histories. Proposition 3(ii) and Appendix D.2 also state that, when each transition keeps its causal prefix and the weights are unchanged, the empirical objective is invariant to grouping turns into episodes or presenting them as separate examples, whereas the prose suggests that keeping episodes intact is itself beneficial.
-
The training-data construction is still insufficiently specified. Appendix C.1 gives the counts and observation variants, but does not identify the specific sources of the 9,000 categorical question-answer pairs and 3,635 additional examples, or fully explain the geometry corrections for displacement and object-distance data. This makes the training set difficult to reconstruct from the manuscript alone; the release of source manifests promised in the Reproducibility Statement would help, but the sources should be named in the paper itself.
Questions for authors
Five questions are listed below. These questions may influence my understanding of the research method and the experiment results.
-
How do the three benchmark scores change when the 2,545 single-turn numerical examples are removed, while matching exposure to the remaining examples and the total training budget as closely as possible?
-
How does training on intact episodes compare with training on separate questions that retain exactly the same complete histories and loss weights?
-
The introduction says existing benchmarks cover all three query types, but also says whether one model can handle them is untested. Is the intended gap multi-task evaluation, or interactions between tasks during joint training?
-
Could you provide the categorical-data sources, the construction rules for the three observation variants, and the geometry-correction procedure, and clarify whether the 243 overlapping ScanNet scenes were removed from training or evaluation?
-
Are both native answers and JSON-wrapped answers subject to the eight-token generation limit on UCS? Does their performance comparison remain the same when this limit is increased?
2 comments
Dear Reviewer 6xeB,
We have uploaded the revised manuscript with the controls and protocol details you requested. Table 21 and Appendix J.1 (p. 39) compare the original numerical labels, corrected labels, and masked single-turn numerical loss. The text now specifies what the masking experiment measures. The remaining examples retain their loss coefficients, total loss mass falls from 1 to 2/3, and the multi-turn pool still supplies numerical supervision. This qualifies how we attribute the change in estimation performance.
Appendix C.1 (p. 20) identifies the categorical data source, reports the frame budgets for all three observation variants, and corrects the description of the VLM-3R labels used in the headline run. Appendix C.3 (p. 21) specifies that the 243 overlapping ScanNet scenes were removed from the OST evaluation candidate set using training-source scene IDs.
For your decoding question, Appendix J.2 (pp. 39–40) records both the original limits and the equal-budget check. On all 8,114 UCS questions, each fixed seed-42 checkpoint generated identical token sequences at the 32- and 64-token ceilings. Every response parsed and finished below both limits. The NATIVE advantage was 3.11 percentage points at either ceiling.
The introduction (p. 1) now frames the research question around the interaction of supervision types during joint training. Section 5.3 (p. 8) also makes explicit that the cyclic shift tests the effect of changing the available history. A direct training comparison of episode grouping with identical histories remains open. Thank you for helping us make these distinctions clear.
A kind reminder of the upcoming end of the discussion period
Dear Reviewer 6xeB,
Thank you for your five questions. Our November 9 response reports the requested control masking the 2,545 single-turn numerical examples and the UCS comparison at common 32- and 64-token generation limits. We also clarify the data sources, label correction, and what the chronological-order experiment establishes.
We would appreciate your feedback on whether the numerical-supervision control and the equal-budget UCS evaluation address your main concerns.