- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
NestSplat addresses segmentation of reconstructed 3D Gaussian scenes from natural language instructions. The paper introduces Nest-LERF and Nest-ScanNet to evaluate relational queries with absent targets and single or grouped targets. The method builds an object vocabulary from scene observations without accessing evaluation queries. It lifts 2D masks into fixed Gaussian supports and computes geometric relations using connected components. A multimodal language model performs target selection with bounded calls. Each query returns no support or one support that may contain multiple matching instances. The method requires no additional semantic training for each scene. The authors report improved segmentation on the proposed benchmarks and additional validation on existing referring and reasoning datasets.
Critical strengths
- The benchmarks explicitly include absent targets and groups of matching objects. This extends mask evaluation beyond the assumption of one referred object. The annotation protocol separates relation categories from target cardinality and includes independent verification and adjudication (Appendix A). These choices provide a useful setting for studying target existence and relational disambiguation.
- Scene preparation produces reusable supports without accessing evaluation queries or learning additional semantic features. Representing connected components separately addresses the geometric distortion caused by a single enclosing box. The controlled analysis supports the usefulness of this design on the evaluated scene (Table 9). Together with bounded model calls, these choices provide a practical pipeline for grounding language in reconstructed scenes.
Critical weaknesses
- The router selects a complete precomputed support and cannot select its geometric components independently (Sec. 3.3). If several instances share a support and no finer candidate exists, then relational reasoning cannot isolate the required instance. This constrains the stated task of single instance disambiguation. Its practical impact depends on whether support construction preserves the distinctions required by the queries. That coverage remains unclear from the provided materials.
- Geometric hints summarize the immediate neighborhood of a single landmark (Sec. 3.3). The inventory selector retains access to all nodes and the results of visual parsing. It remains unclear how the local geometric summary supplies the evidence needed for the full constraints in nested and mixed queries. The component analysis supports the usefulness of geometric hints but does not fully explain their role in composing relations. This leaves the connection between bounded routing and hierarchical reasoning insufficiently established.
- The fallback rule can restore an earlier candidate when inventory selection returns no valid node. Empty masks can also result from insufficient projection coverage (Appendices B.4 and A.5). The provided description does not clearly explain how intentional absence decisions interact with fallback. It is therefore difficult to distinguish deliberate rejection from other causes of empty predictions. This limits their interpretation as evidence that the system recognized the absence of a valid target.
- The benchmark includes appearance attributes and functional cues alongside relational constraints (Appendix A.1). The annotation protocol checks target validity and geometric relations. However, the provided description does not establish how often relational composition is necessary to distinguish the target. Final mask accuracy and scores grouped by relation type cannot resolve this distinction on their own. This limits how specifically the results support the benchmark’s motivation of evaluating hierarchical reasoning.
Questions for authors
None.
Follow-up on Our Rebuttal to Reviewer wUNY
Dear Reviewer wUNY,
Thank you for the time and care you devoted to reviewing our paper and for your valuable feedback. As the discussion period will close on November 18, we would be grateful if you could take a moment to review our rebuttal and follow-up comments.
Please let us know if any concerns remain unresolved or if any part of our response would benefit from further clarification. We would greatly appreciate your feedback and would be happy to address any remaining questions before the discussion closes.
Thank you again for your time and consideration.