- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper targets limited generalization in language-guided 3D affordance grounding, attributing the failure on unseen objects to the query–target gap: a semantic discrepancy between query features encoding interaction intents and the shifted target-region features on unseen objects. It proposes BridgeAfford, which narrows this gap from two complementary perspectives. First, Interaction Region Alignment (IRA) encourages consistent representations of geometrically similar interaction regions across objects during training, via a Category-Agnostic Interaction Memory (CAIM) with Diversity-Aware Initialization (DAI) and Affinity-Based Contrastive Learning (ABCL). Second, Visual Evidence Aggregation (VEA) renders multi-view images with normal-based coloring, applies a lightweight 2D affordance model to localize target regions in each view, and lifts these predictions into dense point-wise 3D evidence (CAMVA) that biases text-to-point cross-attention. Experiments on LASO and PIAD show leading performance, particularly in unseen settings, along with cross-dataset transfer (23.6 aIoU versus 19.7 for ViSPLA) and data efficiency (best aIoU with 20% of the training data).
Critical strengths
1.The problem diagnosis is clear and actionable: the paper quantitatively attributes unseen-object failure to the query–target gap and designs each module to address it, rather than making ad-hoc architectural changes. The resulting gains are large and consistent across benchmarks — best on all metrics on LASO unseen (aIoU 21.8 versus 18.7 for GLANCE) and a large margin on PIAD unseen (14.50 versus 9.20 for the best language-guided baseline). 2. The evidence is complete. Beyond accuracy tables, the query–target similarity analysis (Table 8, Δ from 0.193 to 0.245) and the attention visualizations (Figure 7) substantiate the claimed mechanism, and the fine-grained ablations (Table 5) justify each design choice (geometry-based over label-based alignment, DAI over random initialization, dense CAMVA over sparse keypoints). 3. The design is practically oriented: unlike ViSPLA and HAMMER, it avoids LLMs; CAIM is discarded at inference, leaving only the lightweight 2D model with 6-view rendering; and the data-efficiency study is directly relevant to the costly point-wise annotation setting.
Critical weaknesses
- The improvements are concentrated in the unseen setting, while the seen-setting advantage is marginal and partially behind prior work: on LASO seen, aIoU is only 0.4 above GLANCE (23.7 versus 23.3) with AUC 1.3 lower (86.8 versus 88.1), and on PIAD seen the AUC (87.60) is below HAMMER's 88.43. Readers who weight overall performance rather than unseen-only gains may find the contribution less compelling.
- The novelty is mainly integrative, with key components inherited from prior work: the 2D affordance model is GEAL's 2D branch, the rendering pipeline follows GEAL, and the backbone (Uni3D + RoBERTa) matches GLANCE. The paper's own increments (CAIM/DAI/ABCL/CAMVA) are relatively lightweight. Moreover, the computational overhead of multi-view rendering plus per-view 2D inference is not reported — there is no FPS, parameter-count, or memory comparison against baselines that do not use rendering.
Questions for authors
4
3 comments
For Question 1:
PART is cited in Related Work but not compared numerically. Could the authors add this comparison to the tables and explain the AUC gap?
Thank you for your suggestion. We have added PART’s results to Table 1 in the paper.
IoU measures the overlap between the predicted region and the ground-truth region, whereas AUC measures how well prediction scores rank target points above background points. Improvements in these two metrics therefore do not necessarily occur together. As illustrated in Figure 4, our method typically provides more complete coverage of the target region and produces high responses within it, consistent with its higher IoU. Meanwhile, some high responses may extend beyond the annotated region, causing certain background points to receive higher scores than some target points. This provides one possible explanation for improved regional overlap without a corresponding improvement in AUC.
For Question 2:
QueryMe is not cited; it evaluates on PIADv2, reporting 21.76 aIoU on unseen objects. Although no directly comparable numbers exist, could the authors discuss it and clarify the relation between PIAD and PIADv2 protocols?
Thank you for recommending QueryMe. We have cited and discussed it in the related work section.
We appreciate the value of enhancing query learning through multimodal evidence, particularly its use of 3D interaction information from human–object interaction images to improve affordance grounding, and its strong performance under the unseen-object and unseen-affordance settings of PIADv2. Both QueryMe and our work aim to improve how queries identify target regions, but they consider different input settings. QueryMe uses target point clouds, additional human–object interaction images, and model-generated textual attributes as multimodal evidence. Our work studies language-guided 3D affordance grounding, taking a target point cloud and an interaction instruction as input. VEA derives its visual evidence from multi-view renderings of the target point cloud itself.
Regarding the datasets, PIADv2 extends PIAD by increasing the number of 3D object instances from 7,012 to 38,889, object categories from 23 to 43, and affordance categories from 17 to 24. It retains seen-object and unseen-object evaluation and introduces a separate unseen-affordance setting, providing a valuable benchmark for studying broader generalization.
We did not adopt PIADv2 primarily because it does not directly provide natural-language interaction instruction annotations matching our task. Moreover, prior language-guided affordance prediction methods have not evaluated on this benchmark, leaving no directly comparable baselines. We therefore follow the benchmarks commonly used in prior language-guided affordance studies and evaluate on LASO and PIAD.
Dear Reviewer 3jJr,
Thank you for your time and thoughtful reviews. Please be reminded that the author-reviewer discussion period ends on November 18.
Since the authors have procvided their feedback, please review the feedback and actively participate in the discussion. If you have any remaining questions or concerns, please raise them before the deadline so the authors have sufficient time to respond. Thanks.
Best regards,
AC
Thank you for your careful review and for recognizing our problem diagnosis, supporting analyses, and practical design. We will address your suggestions and questions below.
For Weakness 1:
Thank you for your feedback. We acknowledge that the improvements are primarily in the unseen setting, but our method remains competitive in the seen setting. When compared individually with ViSPLA, GLANCE, and PART, our method shows advantages over each on multiple metrics under the seen setting.
Although our method does not outperform every baseline on every metric, these results demonstrate its competitiveness under the seen setting.
For Weakness 2:
The contribution of our additional modules lies in the representation constraints and spatial guidance mechanisms designed to address the query–target gap.
Specifically, CAIM, DAI, and ABCL jointly form a geometry-driven region alignment mechanism. By constructing geometrically diverse region prototypes and selecting alignment targets according to geometric similarity, they encourage consistent local representations across objects. CAMVA converts multi-view 2D predictions into point-wise 3D evidence and uses attention biases to guide queries toward target-region features. These designs improve performance under the unseen setting.
Regarding computational overhead, we have supplemented timing measurements over 30 runs, reporting the mean ± standard deviation: six-view rendering and 2D inference take 0.973 ± 0.067 s, while complete end-to-end inference takes 1.031 ± 0.059 s. BridgeAfford therefore completes a full prediction, including multi-view visual guidance, in approximately one second while achieving the grounding improvements demonstrated in our experiments.