- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ST-Afford, a 3DGS-based framework for 3D affordance reasoning. It compresses dense Gaussian features into semantically structured shape tokens and dynamically selects and fuses relevant geometric information according to textual intent, aiming to improve affordance grounding accuracy, inference efficiency, and cross-category generalization.
Critical strengths
-
ST-Afford organizes dense Gaussian features into structured representation and recovers Gaussian-level predictions through text-conditioned fusion, providing a reasonable approach to improving the efficiency of 3DGS-based affordance reasoning.
-
Extensive experiments demonstrate that ST-Afford achieves superior performance on both the seen-category and unseen-category datasets.
Critical weaknesses
- The experimental baselines are insufficient. IAGNet and LASO are from around 2024, while recent methods specifically targeting affordance generalization, such as QueryMe[1] or HAMMER[2], are not compared. Without these comparisons, the claimed improvements in grounding accuracy and cross-category generalization are not validated against the current state of the art.
- The evidence for cross-category generalization is limited. The unseen-category evaluation is compared only with 3DAffordSplat, without further analysis of unseen categories. This is insufficient to support the paper’s claim of broad zero-shot cross-category generalization.
[1] Zhao W, Li R, Liu J, et al. QueryMe: Query-Driven Open-Vocabulary 3D Object Affordances Grounding from Multimodal Evidence[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2026: 2603-2612.
[2] Yao L, Chen Y, Su Y, et al. HAMMER: Harnessing MLLM via Cross-Modal Integration for Intention-Driven 3D Affordance Grounding[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2026.
Questions for authors
-
Can you provide fair comparisons with recent affordance-generalization methods such as QueryMe or HAMMER, under a consistent evaluation protocol, to validate the claimed gains in grounding accuracy and cross-category generalization?
-
Beyond comparing only with 3DAffordSplat on the unseen-category set, can you provide further analysis of unseen categories to better support the claim of broad zero-shot cross-category generalization?
3 comments
Dear Reviewer qoJY,
Thank you for your time and thoughtful reviews. Please be reminded that the author-reviewer discussion period ends on November 18.
Since the authors have procvided their feedback, please review the feedback and actively participate in the discussion. If you have any remaining questions or concerns, please raise them before the deadline so the authors have sufficient time to respond. Thanks.
Best regards,
AC
Dear Reviewer,
Thank you again for your valuable comments. Since the discussion period will end on November 18, we really hope you can let us know whether the revised version addresses your main concerns. We also welcome further discussion with you.
Best regards, The Authors
We sincerely thank Reviewer qoJY for their careful reading and positive recognition of our framework's efficiency, token design, and superior performance across both seen and unseen benchmarks. We appreciate the opportunity to address your concerns regarding additional state-of-the-art baselines and cross-category generalization analysis. All corresponding revisions in our updated manuscript are highlighted in blue.
1. Expanding Baseline Comparisons: HAMMER and QueryMe (CW1 & Q1).
A: We fully agree that benchmarking against recent advanced multimodal architectures is crucial. Here is how we addressed both suggested baselines:
We evaluated the adapted HAMMER alongside 3DAffordSplat and ST-Afford on our zero-shot Unseen test set (175 instances across held-out object categories):
As shown above and visualized in Fig. 4, while adapted HAMMER achieves competitive scores on seen objects, its zero-shot generalization drops drastically on unseen geometries (0.1740 IoU). Why does HAMMER degrade on 3DGS compared to standard point clouds? Unlike uniformly surface-sampled point clouds, 3DGS consists of non-uniform, continuous volumetric primitives optimized for radiance rendering—containing dense clusters in high-frequency texture regions and sparse primitives on flat surfaces. Point-cloud backbones rely heavily on isotropic neighborhood grouping (e.g., FPS and ball queries), which suffers from a severe modality gap when handling non-uniform 3DGS distributions on unseen geometries. In contrast, ST-Afford chooses 3DGS for its continuous surface fidelity and rich appearance/opacity cues, and uses SSGE to project these irregular primitives into structured, transferable shape tokens—achieving 0.3793 Unseen IoU (more than double HAMMER's performance).
2. Deepening Analysis on Zero-Shot Cross-Category Generalization (CW2 & Q2).
A: We appreciate this suggestion. Beyond the quantitative improvements in Table 2, our zero-shot unseen benchmark is specifically designed to test whether models can recognize functional structures (such as handles, graspable rims, and trigger regions) across objects with entirely different global shapes (e.g., transferring grasping from seen daily objects to unseen instances like pistols, remotes, microphones, and baskets).
Specifically, we updated the following sections, highlighted in blue in the revised paper: