- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper formalizes the embodied knowledge graph as a factor graph. It gives explicit observation, relation, temporal, and affordance potentials together. Authors try to derive the message passing inference in closed form for the linear Gaussian potentials and through a second order variational linearization for the relation potential. The method is well evaluated on three question answering benchmarks, embodied scene understanding, affordance prediction, and physical adversarial attacks.
Critical strengths
-
The motivation for jointly reasoning about entities, relations, and affordances is great. Relational evidence can help refine uncertain entity states. The factor-graph formulation provides an explicit framework for combining observational, relational, temporal, and affordance constraints.
-
Experiments cover a broad range of downstream tasks, including QA, relation inference, manipulation, and active perception.
Critical weaknesses
- Section 3.3 and Eq. (16) describe fully factorized mean-field updates based on the exponential of an expected log factor, whereas the derivation leading to Eq. (18) appears to marginalize the neighboring Gaussian belief, yielding a correction. These operations generally lead to different updates, and it is unclear how Eq. (18) follows from the stated ELBO or whether an additional approximation is introduced. Since this correction underlies the claimed propagation of neighbor uncertainty, clarifying this connection would help assess the method’s probabilistic interpretation.
Questions for authors
- Could authors clarify how the relation message in Eq. (18) follows from the expected-log mean-field update in Eq. (16)? In particular, does the neighbor marginalization introduce an additional approximation, and how does the resulting update relate to the stated ELBO?
Thank you for your detailed response. It has resolved some of my questions. However, I still have some remaining concerns. For example, when the authors compare with top-venue methods, they refer to "[method] (adapted)." What does "adapted" mean here? In addition, I consider that a considerable amount of revision would be needed to express the logic of this paper more clearly. Therefore, I am inclined to maintain my current score.