- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents SpaEx, a target-aligned spatial reasoning framework that combines object-centric perception, explicit geometric execution, and candidate-level fusion with native VLM scores. It supports viewpoint-dependent relations and metric comparisons while keeping the perception models and VLMs fixed during reader calibration. Experiments on SpatialMQA, SPAR-Bench, and CV-Bench 3D demonstrate consistent improvements over task-adapted baselines across two VLM backbones. Ablations further investigate the benefits of executed evidence over aligned spatial states and the complementary roles of geometric execution and native VLM predictions.
Critical strengths
-
SpaEx consistently improves performance across three spatial reasoning benchmarks and two VLM backbones. The matched comparisons, multiple random seeds, and additional-training controls provide convincing empirical support.
-
The ablations distinguish geometric execution from native-score fusion and demonstrate that explicitly computed candidate evidence can be more effective than presenting aligned spatial states directly to VLMs. The analysis of complementary predictions is particularly valuable.
Critical weaknesses
-
SpaEx primarily supports predefined spatial operations and benchmark-specific interfaces. Only 380 of 1,076 SpatialMQA test questions admit execution, while SPAR-Bench and CV-Bench exploit public task specifications or visual markers. Generalization to unrestricted spatial reasoning remains unclear.
-
The framework largely integrates existing perception, geometric operations, and score fusion. The aligned-state comparisons do not fully isolate execution from differences in representation and available information. Moreover, adaptive fusion provides little improvement over constant fusion and no additional accuracy on CV-Bench, weakening the justification for the proposed adaptive reader.
Questions for authors
-
Can the authors provide a more tightly controlled comparison between aligned-state readout and executed evidence, matching native-score access, input representation, and training budget? How would SpaEx compare against a complete APC implementation?
-
How well does SpaEx generalize to spatial questions without benchmark-specific markers or task categories? Can the authors quantify the impact of extending execution coverage beyond the currently supported SpatialMQA questions?
Response to Reviewer LAL6
Thank you for the positive assessment and the precise questions. Results below are new unless a table of the paper is cited; details will be in the revised appendix. Two numbers are Qwen / LLaVA; SPAR is the task macro.
Q1 (W2). A tighter state-versus-execution comparison, and complete APC.
Tighter comparison. Two controls give both readers the same information and vary only whether the candidate comparisons are executed (three seeds, full test sets):
The internal readers share operands, candidate binding, capacity, examples, updates and loss. Both text readers receive the aligned state, the executor's conventions, native scores and entropy, and are trained on the same 502 examples. Execution wins all 18 internal-reader cells (+3.3 to +19.3 points) and all six text-reader seed pairs (+7.4 / +10.1 on average).
Complete APC. We ran the official APC visual pipeline. It reproduces its published 3DSRBench numbers (70.5 / 65.9 against 72.78 / 66.47). Under our protocol (original questions and candidates, accuracy in %):
With the same backbones and adapters, APC is 11–31 points below the matched LoRA alone and 27–42 points below SpaEx. The paper's APC-style control stays labelled as a shared-observation control.
Q2 (W1). Generalization without markers or task categories; quantifying a coverage extension.
W2. Positioning and adaptive fusion.