- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes a method to iteratively complete and correct predicted functional scene graphs from fixed RGB-D observations through active agentic evidence seeking. The authors argue that the current two-stage, one-shot feedforward pipeline for 3D scene understanding, which identifies object and part nodes first and then infers relations over the fixed detected nodes, is especially fragile for functional parts because they are difficult to detect, and a missed detection prevents all corresponding functional relations from being generated in the second stage. To this end, the authors propose using one agent to identify potentially missing parts and seek evidence and another agent to review the proposals, alternating their roles to progressively complete the graph. The method is benchmarked against baselines on three indoor scene-level datasets, and the results show improvements over the baselines, especially on metrics related to functional parts.
Critical strengths
The paper identifies a meaningful limitation of current functional scene-graph pipelines: missing a functional part during initial perception prevents its associated relations from being recovered later. Using the current graph to guide iterative evidence acquisition is a reasonable solution to this problem.
Critical weaknesses
- The source of the improvement is unclear. AcFunSG uses GPT-4.1 for the initial FunFact pipeline but GPT-5.6 Luna during active repair, while also performing substantially more inference. It is therefore difficult to determine whether the gains come from the proposed agentic procedure, the stronger model, or simply additional access to the images. I suggest using GPT-5.6 Luna for the initial scene analysis in FunFact and reporting the results to clarify whether the gains come from feeding the image data to a stronger model during the active evidence acquisition stage.
- The computational cost is too high relative to the improvement. Active repair requires an additional 194.5–403.5 logical model calls per scene. This makes it unclear whether the active-agent component provides a favorable performance–cost trade-off.
Questions for authors
- The abstract mentions “uncertainty-guided evidence acquisition” and the selection of “informative views and queries.” However, Section 3.4 mainly describes an agent choosing an object, query, view, and update. It is not clear to me how uncertainty and informativeness are represented. How are parent objects selected? How are available views ranked?
- In the section “Hierarchical consistency (HC) for multi-view identity association,” the authors state that partial visibility and segmentation errors can cause different geometric extents for the same object, resulting in incorrect merging and motivating hierarchical consistency. The motivation is not clear to me, as detections with different geometric extents would tend to be harder to merge.
- Does the system fix existing graph errors, or does it mainly add missing parts? The manuscript repeatedly mentions graph correction. However, Section 3.4 mainly formalizes the addition of missing parts through hypothesis proposals. What graph-edit operations are supported?