- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work studies language-guided 3D affordance grounding from partial multi-view RGB-D observations by employing a pretrained PCDreamer backbone for amodal point cloud completion, followed by localization-aware reliability estimation, reliability-guided local detail refinement, and query-guided spatial-functional graph reasoning. The proposed framework is evaluated on the Affogato benchmark through quantitative comparisons and ablation studies under incomplete observations.
Critical strengths
- In my view, this work investigates a valuable problem in partial-view 3D affordance grounding. Noting that generative point cloud completion may introduce geometric inaccuracies in occluded areas that affect downstream localization, the motivation to consider local reconstruction reliability during feature processing is reasonable.
- The two-stage training strategy is well designed, and the progressive ablation studies clearly demonstrate the contribution of each component.
Critical weaknesses
- Insufficient Evidence for Query-Conditioned Reliability: Eq. (2) incorporates language features to predict query-conditioned reliability, whereas the explicit supervision in Eq. (3) depends solely on geometric Chamfer distance. Although the downstream localization loss may indirectly introduce query dependence, the paper does not explain or empirically demonstrate whether the predicted reliability genuinely captures query-specific information rather than query-independent reconstruction quality.
- The manuscript omits essential technical definitions, including how completion confidence is extracted in Eq. (2), the specific operators in Eqs. (2), (4), and (6), the message-passing formulations in Sec. 3.4, and the exact loss functions in Sec. 3.5. Furthermore, Sec. 4.1 lacks the view-sampling protocol, point cloud resolution, point-to-GT metric mapping strategy, and the standard Affordance Chamfer Distance (aCD) metric.
- The comparison with completion-free methods (OpenAD, PointRefer, and Espresso-3D) may be unfair due to differences in the evaluation protocols. In Table 2, the simple Completion baseline (19.8 aIoU) already outperforms the best baseline in Table 1 (19.1 aIoU), suggesting that much of the improvement may come from the PCDreamer backbone rather than the proposed modules. A fairer comparison with baselines such as PCDreamer + Espresso-3D and PCDreamer + Affostruction is needed.
- In Fig. 3, the zoomed-in results of PointRefer, Espresso-3D, and Affostruction look nearly identical across five objects, and the "Depth Prior" column is not explained. The predicted reliability maps are also missing. In addition, Table 4 lacks baseline comparisons, while Table 5 does not distinguish between observed and reconstructed regions.
Questions for authors
- How does Eq. (2) learn meaningful query-dependent reliability, and can the authors validate this through an ablation of the language features? Could they also clarify the completion confidence, graph message passing, and region-to-point mapping? 2.Were the baselines evaluated on partial or completed point clouds, and could the authors provide fair comparisons using the same PCDreamer backbone, along with aCD and inference time ? 3.Why do the baseline predictions in Fig. 3 appear nearly identical across several objects, and how do reconstruction errors and affordance localization performance differ between observed and unobserved regions?
2 comments
3. Prediction behavior and reliability under different observation conditions.
The predictions in Fig. 3 may appear visually similar because the compared methods receive the same partial observations and affordance queries, and therefore identify broadly similar semantically relevant functional regions. Their differences are more evident in the spatial coverage and boundary accuracy of the predicted regions, particularly where the available geometric evidence is incomplete. Our method addresses this challenge by incorporating observation-state information and query-conditioned reliability into local feature refinement, followed by spatial-functional reasoning that exploits contextual relationships among regions.
We further clarify the scope of our quantitative reliability analysis. Table 5 groups local regions by their predicted reliability and reports their corresponding reconstruction errors and localization accuracy:
| Predicted Reliability | Local Reconstruction Error | Local aIoU (%) |
|---|---|---|
| 0.00–0.25 | 0.182 | 15.7 |
| 0.25–0.50 | 0.141 | 18.9 |
| 0.50–0.75 | 0.103 | 23.1 |
| 0.75–1.00 | 0.071 | 28.6 |
The decreasing reconstruction error and increasing local aIoU indicate that higher predicted reliability is associated with more accurate local geometry and better affordance localization. This supports the use of reliability to regulate local refinement. We emphasize that Table 5 analyzes regions grouped by predicted reliability, rather than directly comparing observed and unobserved regions. Similarly, Table 4 evaluates visibility at the whole-object level. These analyses provide complementary evidence of robustness under incomplete observations, but do not constitute a separate quantitative comparison of reconstruction errors and localization accuracy between observed and unobserved regions.
Overall, the proposed framework does not assume that all reconstructed regions are equally reliable. Instead, it estimates their usefulness for the current affordance query, selectively refines local features, and exploits spatial-functional context to improve final localization.We have revised the Qualitative Results in the manuscript subsection to clarify the comparison among methods, and the Robustness to Observation Completeness and Localization Reliability Analysis subsections to supplement the relevant analyses.
We thank the reviewer for raising these related questions. We clarify the implementation of query-conditioned reliability estimation, provide a controlled comparison protocol, and further explain the qualitative prediction behavior and the scope of our reliability analysis.
1. Query-conditioned reliability estimation and implementation.
In Eq. (2), the predicted reliability is jointly estimated from the local geometric feature (\alpha_i), PCDreamer completion confidence (c_i^{pcd}), observation state (m_i), and language feature (F_T): ui=σ(ψ(αi,cipcd,mi,FT)). Here, (c_i^{pcd}) represents the completion confidence associated with the local region, whereas (m_i) indicates whether the region is directly observed or reconstructed. Importantly, the reliability target in Eq. (3) is derived from local geometric reconstruction discrepancy: ui∗=exp(−β,CD(Si,Sigt)). Thus, the Chamfer Distance provides geometric supervision, while the language feature enters the reliability predictor rather than the target construction. The query dependence comes from conditioning the prediction on (F_T): the same reconstructed region can receive different reliability estimates under different affordance queries. The subsequent localization objective further encourages the learned representation to support query-specific functional localization.
To validate the contribution of language conditioning, we conduct an additional ablation by removing (F_T) from the reliability estimator while keeping the remaining architecture and training protocol unchanged.
The consistent improvements indicate that language conditioning provides useful information beyond local geometry, completion confidence, and observation state.
For spatial-functional reasoning, each local region is represented as a graph node. Geometry-based spatial relations and query-conditioned functional relations are propagated separately and then integrated to update the regional representations. Finally, the localization head predicts a score for each region, and these regional scores are projected onto their constituent points to obtain the dense affordance prediction.We have revised the Ablation Study subsection in the manuscript to include the language-feature ablation, and the Reliability-Guided 3D Affordance Grounding subsection to clarify the reliability estimation and spatial-functional reasoning mechanisms.
2. Fairness and consistency of baseline comparisons.
In the original Table 1, baseline methods follow their respective evaluation protocols, which may involve different input conditions. Therefore, these results provide a reference comparison rather than a strictly controlled ranking. We explicitly acknowledge this distinction and avoid attributing all performance differences solely to the proposed modules.
To provide a more controlled evaluation, we additionally compare the methods using the same PCDreamer completion backbone and identical completed point clouds, data splits, and evaluation settings. In addition to the original affordance metrics, we report average Chamfer Distance (aCD) and inference time to assess localization quality, geometric accuracy, and computational cost.
Under this controlled setting, our method achieves the best aIoU, SIM, and aCD, while Espresso-3D obtains better AUC and MAE. The additional refinement and spatial-functional reasoning introduce extra inference time. These results therefore demonstrate the benefit of our approach in localization overlap and geometric accuracy, while also making its computational overhead explicit.