- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates 3D scene understanding in multi-turn conversations and introduces ScanFlow, a benchmark comprising 679 scenes and 17.3K dialogue turns, covering conversational question answering and 3D object grounding. The authors further propose 3DMem, which integrates textual memory and continuous spatial memory to model contextual information across dialogue turns. The framework is optimized through supervised fine-tuning and IoU-aware GRPO. Experiments compare the proposed method with several existing 3D-LLMs, and ablation studies are conducted to evaluate its effectiveness.
Critical strengths
-
The research problem is meaningful. Existing 3D-LLMs primarily focus on single-turn interactions. The proposed ScanFlow provides a new benchmark for evaluating cross-turn reference disambiguation, context accumulation, and spatial grounding, addressing a practically relevant research challenge.
-
The method design is reasonable. The dual-memory mechanism explicitly maintains conversational states and spatial associations, offering a more targeted solution than simply concatenating dialogue history. The experimental results also provide preliminary evidence of its effectiveness.
Critical weaknesses
-
The fairness of experimental comparisons and the significance of performance improvements require further justification. The baselines in Table 3 are not fine-tuned on ScanFlow, which may exaggerate the reported improvements. Under the standardized SFT setting in Table 5, the performance gains over strong baselines become considerably smaller. Moreover, comparisons of training costs, parameter counts, and inference efficiency are missing, making it difficult to assess whether the additional architectural complexity is justified.
-
The ablation studies are insufficient. Table 4 primarily analyzes the effects of disabling components during inference, without independently trained comparisons among Text-only, Spatial-only, and Dual Memory configurations. Furthermore, systematic ablations of IoU-aware GRPO and the individual training stages are missing, leaving the necessity of these components insufficiently demonstrated.
Questions for authors
-
Could the authors provide comparisons with fully fine-tuned baselines under similar training budgets and parameter configurations, along with an analysis of the additional computational costs?
-
Could the authors conduct independently trained comparisons among Text-only, Spatial-only, and Dual Memory configurations to demonstrate the necessity of the proposed dual-memory mechanism?
-
Could the authors provide separate ablation studies for the different training stages and IoU-aware GRPO to clarify their individual contributions to the final performance?
-
Could the authors provide more details about the quality of human verification in ScanFlow and evaluate the model's generalization to longer conversations and diverse dialogue expressions?