- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HPSSG, a hierarchical prototype learning framework for RGB-D sequence-based 3D scene graph generation. HPSSG models nodes and edges with semantic-level and mode-level prototypes to improve inter-class separability while capturing diverse intra-class patterns. The framework further introduces two strategies: Hierarchy-aware Prototype Entailment Learning, which maintains hierarchical consistency by constraining mode-level prototypes within the semantic cones defined by their corresponding semantic-level prototypes, and Prior-guided Compositional Prototype Learning, which leverages subject-object mode-level prototypes to guide the selection and refinement of edge mode-level prototypes. Experiments on the 3DSSG dataset demonstrate that HPSSG outperforms previous methods without additional inference cost.
Critical strengths
-
The paper presents a well-motivated hierarchical prototype learning framework to address inter-class similarity and intra-class diversity in 3D scene graph generation. The overall framework is intuitive and clearly structured.
-
The proposed method achieves notable improvements on the 3DSSG benchmark under both reconstructed dense and ground-truth point cloud settings, surpassing the best reported baselines in the corresponding comparison tables by 4.3% and 4.5% respectively. These improvements are achieved without increasing inference parameters or latency, demonstrating the effectiveness and efficiency of the proposed approach.
Critical weaknesses
-
The paper does not adequately discuss or compare against GMPSSG (ICML 2026), which addresses the same RGB-D-based 3D scene graph generation task and also tackles inter-class similarity and intra-class diversity through prototype learning. The authors should clarify the key technical differences and provide a direct experimental comparison under consistent settings. In addition, in Appendix D, the authors explicitly write "our method GMPSSG" when referring to their own method, despite GMPSSG being entirely absent from the main discussion. This naming error suggests that the authors were aware of GMPSSG.
-
The method assigns the same number of mode-level prototypes (K=5) to every object and relation category, despite their potentially different levels of intra-class diversity. For example, an object category such as "chair" may naturally exhibit multiple distinct modes due to variations in shape, size, and structure. However, for a relation category such as "attached to" or "standing on", it is less clear whether its different instances exhibit a comparable degree of diversity that would justify five distinct prototypes. Although Table 4(a) shows that K=5 achieves the best overall performance, these results do not explain why the same number of modes is appropriate for both object and relation categories.
References:
- Learning Gaussian Mixture-distributed Prototypes for 3D Scene Graph Generation from RGB-D Sequences. Rongxing Ding et al., ICML 2026.
Questions for authors
-
How does HPSSG differ from GMPSSG (ICML 2026) in terms of its core technical contributions? Could the authors provide a quantitative comparison with GMPSSG under consistent experimental settings? Such a comparison would be important for assessing the novelty and effectiveness of the proposed method.
-
Could the authors clarify why K=5 is used for both object and relation categories? Given that relation categories may have different levels of intra-class diversity compared with object categories, what evidence supports assigning the same number of prototypes to both? A concrete analysis of the learned relation prototypes would help clarify whether all five prototypes capture meaningful and distinct patterns.
Thank the authors for the author’s response, especially the comparison with the 2026 method; the additional experiments provided by the author address my concerns regarding the paper’s effectiveness. However, the explanation of the paper’s novelty only partially resolves my concerns. The paper’s novelty remains incremental; thus, I maintain my previous recommendation of a weak acceptance.