- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
DSG addresses multimodal few-shot point cloud segmentation through support-derived semantic prototypes and query-derived structural anchors, each estimated by one FPS-initialized Lloyd/Hard-EM update. Improvements span S3DIS, ScanNet and multiple way/shot settings. SRI transfer and boundary evaluation provide useful supporting evidence; the appendix discloses the classical clustering equivalence and the limits of the representation analysis and high-way training.
Critical strengths
- Clear problem framing.
- Consistent main results plus stability evidence.
Critical weaknesses
- The probabilistic interpretation needs a clearer connection to inference. Appendix F.1 identifies the updates as classical single-step Lloyd/Hard-EM refinement. The pathways are subsequently fused through attention, while low CKA/RSA does not establish functional independence. Please define decoupling and explain its benefit to the final prediction. For fixed representations and a nonzero normalizer, the label-independent geometric factor in Eq. (3) cancels upon posterior normalization; please explain its relationship to the implemented fusion.
- Query-anchor benefits need more direct attribution. SRI uses the unlabeled query distribution. Transduction is legitimate here; attMPTI also uses it (Zhao et al., 2021). A support-derived-anchor control could identify the benefit of query adaptation. A capacity-matched generic query-refinement control under the same inputs and episode protocol would help distinguish the structural design from added capacity and query modeling.
- Robustness to noise and initialization is incompletely characterized. Modality ablations establish usefulness, but not tolerance to corrupted features or 2D-3D misalignment. One assignment-and-mean update may depend on the FPS selection and outliers. A limited alignment-noise or initialization perturbation test would help; alternatively, please delimit robustness claims to tested conditions. Fixed initialization itself does not imply random predictions.
- The structural prior and anchor budget need clearer limits. Table 12 already varies anchor counts, and Appendices B.1/G.3 acknowledge geometric–semantic conflicts. Anchors operate in learned feature space, not a purely spatial partition. Please explain what the existing evidence establishes about the default budget across scene complexities, and qualify boundary-preservation claims where geometry and semantics disagree.
- Training cost limits demonstrated scalability. Appendix E.3 reports nearly 80 GB for MM-FSS 2-way 5-shot training and identifies higher-way training as a limitation. This differs from Table 5’s 0.06-second inference overhead. Tables 6-7 offer a lower-cost 2,048-point/DGCNN configuration. Please specify the feasible way/shot range and accuracy–memory trade-off, distinguishing backbone and point-budget effects from module costs.
Questions for authors
-
Eq. (3) writes the posterior as a product of semantic likelihood and a label-independent geometric prior. After normalization, a query-only factor cancels unless it modulates the likelihood. How is the Geometric Prior actually realized in Eq. (15)–(16): as a multiplicative prior, an additive logit bias, or an implicit cross-attention modulation?
-
Why query-derived anchors help beyond support prototypes. SRI uses the unlabeled query distribution. Mechanistically, what does a query anchor capture that a support prototype cannot? Is the benefit from query adaptation itself, or from the added cross-attention capacity?
-
Eq. (13)–(14) gates visual likelihood by text affinity T. If the text prior is ambiguous or misaligned with the 3D domain, does the gating amplify the error rather than suppress it? Is there a mechanism to down-weight unreliable text evidence, or does TMSA assume the VLM prior is always informative?
Thank you for the detailed response and the substantial effort put into the revisions and new experiments. I have also read the reviews by ANwM and NDfT. Like ANwM, I had concerns about novelty and the component ablations. Like NDfT, I questioned the probabilistic explanation and whether the query-anchor benefits came from added capacity. I also shared their concerns about the geometric interpretation of the anchors. The revised explanations and the added SRI-only, anchor-source, and capacity-matched tests address these concerns well. The repeated training runs, cross-dataset tests, and frozen-feature comparisons also respond to several of my other requests. These additions strengthen the evidence for the method. My assessment of the paper is now more positive.
For the revised manuscript, I have a few suggestions:
Please make sure the key experiments are fully included in the paper or supplementary material. A short summary with clear table references would help readers follow the evidence.
Please clearly state the prototype budgets and evaluation settings. Also distinguish training-run variation from test-time initialization variation, and per-GPU memory from four-GPU totals.
Please briefly clarify the settings used for the k-means and Hard-EM results in the original Table 13.