- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Disentangled Spatial Reasoner (DiSR), a framework that separates 3D perception from spatial reasoning. It uses pretrained perception models to construct structured 3D geometric evidence and fine-tunes an LLM with LoRA to reason over this evidence. The approach aims to reduce the need for large-scale 3D VQA training while improving interpretability and training efficiency. Experiments on 3DSRBench, SPAR-Bench, and CV-Bench-3D demonstrate competitive spatial reasoning performance, with improvements on 3DSRBench and SPAR-Bench. The paper also provides diagnostic analyses of different pipeline components and evaluates the framework with different MLLM backbones.
Critical strengths
-
Effective and training-efficient framework. The proposed approach achieves strong performance on multiple spatial reasoning benchmarks, particularly 3DSRBench and the metric estimation tasks in SPAR-Bench, while requiring substantially less downstream training data and reported training GPU hours than several specialized baselines. These results demonstrate the practical potential of combining pretrained 3D perception models with lightweight LLM adaptation.
-
Interpretable and modular design. By explicitly constructing structured 3D evidence, DiSR enables a clearer separation between perception and reasoning. The ground-truth replacement experiments provide useful insights into the sources of errors, while the cross-backbone evaluation offers initial evidence of the framework's extensibility.
Critical weaknesses
-
Insufficient ablation studies to isolate the key contributions. The paper lacks critical comparisons, such as using structured 3D evidence without LoRA fine-tuning and fine-tuning the original MLLM under comparable training conditions without the proposed evidence representation. Consequently, it is difficult to determine how much of the reported improvement comes from explicit 3D evidence, task-specific fine-tuning, or their combination.
-
Limited methodological novelty and insufficient validation of the central claim. The proposed framework primarily integrates existing 3D perception models with an LoRA-adapted LLM through a structured textual interface. While the empirical results are promising, the experiments mainly demonstrate the effectiveness of the complete pipeline rather than establishing why disentanglement itself is preferable to alternative approaches. This weakens the evidence supporting the paper's central methodological contribution.
Questions for authors
-
Contribution of structured 3D evidence versus LoRA fine-tuning. The paper reports substantial improvements over the original Qwen3-VL-8B, but it remains unclear how much of the gain comes from the explicit 3D evidence and how much comes from the 330K training samples. Could the authors provide controlled comparisons using (i) structured 3D evidence with the frozen, non-fine-tuned LLM and (ii) RGB-based fine-tuning under comparable training conditions? These results would help establish whether the improvement primarily comes from disentanglement or task-specific supervision.
-
Necessity and effectiveness of the proposed disentangled reasoning framework. Since DiSR integrates existing 3D perception models with an LLM through a structured textual interface, could the authors clarify what distinguishes the proposed method from simpler modular baselines? In particular, for depth and distance estimation tasks, how does the LoRA-adapted LLM compare with directly applying deterministic geometric computations to the same reconstructed 3D evidence? Such comparisons would help clarify the specific contribution and necessity of the learned reasoning module.
-
Training data construction and efficiency comparison. Could the authors provide more details about the composition and generation of the 330K training samples, including the proportions of question-parsing, spatial-reasoning, and synthetic data? Additionally, does the reported computational efficiency account for the cost of generating 3D evidence using the pretrained perception models? Clarifying these aspects would help assess the reproducibility and fairness of the efficiency claims.
2 comments
Official Comment by Authors
Dear Reviewer fHEL,
Thank you again for your constructive review.
We have responded to all the questions and concerns in above comments. As the discussion closes in a few days, we would be grateful to know whether these results resolve your concerns, or whether any specific issue still requires clarification. If the new evidence changes your assessment, we would sincerely appreciate your reflecting that in your final score. Thank you again for the constructive discussion.
Best,
Authors
Response to Reviewer fHEL
Q1. Contribution of structured 3D evidence versus LoRA fine-tuning: can the authors compare a frozen LLM with structured evidence and RGB-based fine-tuning under comparable conditions?
Reply: Thank you for this suggestion. We compare RGB and evidence-language adaptation using the same 1.2K real-image question–answer instances. Both start from the untuned Qwen3-VL-8B and train for ten epochs with rank-128 QLoRA, learning rate 2×10−5 and effective batch size 16. The photographs, questions, options and labels are identical.
The evidence branch trains language adapters with question-parsing and numerical reasoning/answer supervision. The RGB branch trains vision-encoder/merger and language adapters with only the final option letter as the target. Table R1 reports their results on the full 3DSRBench test set.
Table R1. Full 3DSRBench accuracy and training time for the 1.2K-QA comparison, with the RGB backbone as a baseline. The best accuracy is bold and the second best is underlined.
Evidence-language adaptation exceeds RGB adaptation by 5.58 percentage points. The untuned evidence baseline is already strong, with adaptation adding 0.47 points. Thus, the comparison supports the value of explicit 3D evidence in this small-data setting. The supervision and updated modules of the two training schemes are specified above.
Q2. What distinguishes DiSR from simpler modular baselines, and how does the learned reasoner compare with deterministic geometric computation on the same reconstructed evidence?
Reply: DiSR learns to map natural-language questions to object slots and to answer from a shared geometric representation. A deterministic solver requires a program to specify the operation and object roles. Table A9 in Appendix F of the revised manuscript compares these answering methods on all test questions in eight directly computable relations: the solver achieves 69.13%, versus 60.06% for the untuned evidence-conditioned LLM and 69.36% for DiSR-8B-LoRA. Across all twelve relations, the solver achieves 66.41%.
For the reviewer’s depth/distance examples, the CV-Bench-3D solver achieves 91.17%/90.50%, compared with 92.83%/91.67% for the submitted DiSR model. On questions with complete object centers, their predictions agree exactly. We agree that these tasks can be solved effectively by geometric programs. DiSR’s contribution is the learned question-to-evidence interface and a shared answering model across spatial tasks.
Q3. Please clarify the construction and composition of the 330K training samples, and whether the efficiency comparison includes the frozen experts’ evidence-generation cost.
Reply: Thank you. Data construction consists of real-image evidence collection, geometric expansion and two-stage training. The real-image stage produces 1.2K image–question–answer instances using the frozen perception pipeline. Each instance is converted into a question-parsing target (Q,P) and an evidence-conditioned reasoning target (Q,ET,A).
The expansion stage samples object centers, extents, sizes and orientations over ordinary, long-tail and near-boundary configurations. Geometric rules determine the answer for each sampled configuration and produce its numerical reasoning target. The sampled geometry is serialized into the same evidence format used at inference. This expands coverage without running the perception experts for every synthetic example.
The reported 0.33M corpus contains 328,157 supervision rows: 161,100 question-parsing rows and 167,057 reasoning rows. Training uses two stages of 112,157 and 216,000 rows, with one epoch per stage. The 1.2K-QA experiments in Table R1 use ten epochs for the RGB/evidence comparison.
The reported 58.75 GPU-hours cover only the two optimization stages. For the real-image collection, summed per-image processing time is 3.33 hours for the 1,350 images from which the 1.2K instances are selected.