- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
LDSGSeg combines local geometric statistics and class-name information for few-shot point cloud semantic segmentation. Covariance-eigenvalue descriptors are projected into the encoder, while frozen CLIP text embeddings condition query features and support prototypes. The full model improves all eight dataset/way/shot average results over TaylorSeg-PN on S3DIS and ScanNet, without additional image inputs or task-specific 3D pretraining. The paper provides component, placement and semantic-input controls; Table 5 supports the usefulness of correctly aligned class semantics. Parameter counts and increased training time are also disclosed.
Critical strengths
- Two limitations are stated as concrete mechanisms.
- LDE injects geometry at the right place.
- Semantic-input control is well designed.
Critical weaknesses
- The advance over established descriptors and fusion operations needs clearer positioning. Linearity, planarity and sphericity from covariance eigenvalues are classical point-cloud descriptors; PTCA and PCC use established cross-attention and channel-gating operations. Table 3 already compares separate and joint conditioning. Please explain what task-specific insight or capability the joint design adds beyond these components. The already-cited GPCPR (Wei et al., 2024) offers a relevant semantic-prototype comparison; please include it under explicit pretraining and semantic-resource conditions, or explain why the protocols are not comparable.
- The LDE gain is not fully separated from added capacity and residual initialization. The disclosed parameter count increases from 0.27M for TaylorSeg-PN to 0.47M, approximately 74.1%. Table 5 retains the semantic architecture and supports the value of correctly aligned text, but does not isolate the extra LDE capacity. Please compare LDE with a similarly sized visual residual branch using the same initialization. The learnable zero-initialized scales are a valid optimization choice; their role should be distinguished from the information carried by the branches. A small nonzero-scale comparison with architecture and training fixed could provide an additional, optional diagnostic of the initialization effect.
- The background token and prompt choice need a clearer empirical scope. In Eqs. (11)-(13), the zero background text token is combined with a visual background prototype, so its gate remains input-dependent. However, foreground prototypes receive language conditioning while background does not. Please justify this asymmetry and characterize background false positives on the existing episodes. Table 5 supports correctly aligned CLIP semantics, but evaluates one prompt template; either a small paraphrase check or an explicit limitation to the tested template would clarify the scope of that result.
- Some geometric-branch details require clarification for reproducibility. The descriptors are projected through point-wise convolution, batch normalization and ReLU before addition, and their contribution is scaled by a learnable coefficient. Please specify the stage dimensions, relative-coordinate normalization, numerical handling of degenerate neighborhoods, and whether gradients through covariance eigendecomposition are required. These are implementation questions; the manuscript does not establish numerical collapse or feature corruption, and they are secondary to the contribution and attribution concerns above.
Questions for authors
-
What does LDE add beyond classical descriptors? Linearity/planarity/sphericity are standard covariance features. Is the mechanism-level claim that these descriptors are newly fused into HiConv before pooling, or that the specific descriptor triplet captures something prior local aggregators miss? If the former, what does the HiConv injection enable that concatenating d_i to the point feature would not?
-
Why condition queries and prototypes separately? PTCA and PCC both consume E, but at different stages. Does PCC's channel gate operate on information PTCA cannot reach (prototype-level category prior vs. point-level context)? Is there a mechanism reason the two cannot be merged into one text-conditioned matching step?
-
What is the background asymmetry doing? Foreground prototypes get text conditioning; background gets a zero token. Since the gate is input-dependent, the zero token still yields a data-driven gate. Mechanistically, does this asymmetry risk making background less calibrated than foreground, and is that visible in false-positive behavior?
-
Is the LDE gain separable from capacity? The zero-initialized α_i means LDE starts as identity. Does the gain come from the descriptor information itself, or from the extra parameters becoming active during training? A same-size visual residual branch with identical initialization would clarify what the covariance eigenvalues specifically contribute.
-
What happens when class names are semantically close? The prompt is "a point cloud scan of a {class}." For fine-grained or ambiguous categories, does PTCA's attention distribute mass across several foreground classes rather than committing? Is there evidence the text branch helps most when visual prototypes are ambiguous?