- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces ChronoGraph, a functional 4D scene graph representation that models objects, affordance parts, actions, semantic states, spatial relations, and action-induced state changes. Based on this representation, the authors construct ChronoGraphBench from HD-EPIC, Hoi!, and RoboCasa, and generate graph-annotated questions for interaction understanding and spatially grounded planning. ChronoGraphVLM is trained with graph-as-chain-of-thought supervised fine-tuning followed by joint 4D graph reinforcement learning. The paper reports improvements over pretrained baselines on ChronoGraphBench, zero-shot transfer to the egocentric split of VLM4D, and qualitative demonstrations on a mobile manipulation platform.
Critical strengths
- The paper proposes a coherent functional 4D scene graph that connects objects, affordance parts, actions, semantic states, and action-induced state changes. This is a meaningful formulation for bridging interaction understanding and grounded planning.
- The empirical setup spans egocentric human videos, simulated robot data, and a real-robot demonstration, with component ablations that provide useful evidence for the proposed training design.
Critical weaknesses
- The OOD evaluation is limited to VLM4D, which is still a closely related 4D understanding benchmark. Without before/after evaluation on broader spatial-understanding or VQA benchmarks, it is unclear whether post-training preserves the model's existing general capabilities, causes forgetting, or generalizes beyond the particular 4D task family.
- The benchmark relies centrally on a half-automatic scene-graph construction pipeline, but the paper provides limited quantitative validation of the resulting graph quality and no systematic error analysis on ChronoGraphBench. This limits confidence that the reported gains reflect robust functional 4D reasoning rather than sensitivity to annotation noise, templates, or the benchmark distribution.
Questions for authors
- Can the authors evaluate ChronoGraphVLM and the corresponding base models on several general spatial reasoning (such as VSI-Bench/EmbSpatial) and general VQA ( such as BLINK/V*) benchmarks? This would clarify both generalization and catastrophic forgetting.
- What fraction of automatically generated graph annotations are sent to human review, and how often do human reviewers modify nodes, edges, state transitions, 2D/3D boxes, or QA answers? Please report these statistics separately for HD-EPIC, Hoi!, and RoboCasa. Moreover, Can the authors provide a quantitative annotation audit, including semantic graph accuracy, temporal transition consistency, object identity consistency, 2D/3D grounding error, and QA validity, together with randomly sampled failure cases?
- Can the authors provide a systematic error pattern analysis on ChronoGraphBench, separating graph-generation errors from final-answer errors, so that we can know more about the boudnaries of model capacity, and what kind of capacities can(not) be improved through training on ChronoGraphBench?