- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies an important and under-examined question: why egocentric signals produce small and inconsistent improvements in human motion forecasting. Its main strength is the diagnostic perspective that modality value should be analyzed conditionally across temporal windows, motion states, body joints, and information availability.
The state- and joint-level analyses provide meaningful evidence that egocentric gains are heterogeneous and that aggregate metrics may conceal useful conditional effects. The controlled comparison between models with and without egocentric input is also preferable to comparisons that simultaneously change the input and architecture.
Nevertheless, several central claims are stronger than the experimental evidence supports.
Critical strengths
-
The paper presents a clear and relevant motivation. Existing studies report small and inconsistent improvements from egocentric signals, but architecture changes and modality changes are often confounded. The controlled comparison between models with and without egocentric inputs is therefore useful.
-
The paper is generally clearly structured. The when–where–what organization provides an intuitive framework for studying modality contribution. It encourages evaluation beyond a single aggregate performance number.
-
The state- and joint-level analyses are informative. On MoGaze, the gain is larger during walking with fixation and at the acting wrist and elbow. These results support the claim that aggregate metrics can conceal heterogeneous effects.
-
The paper distinguishes global trajectory prediction from local articulation using Global MPJPE, Local MPJPE, and Root Destination Error. This reveals that egocentric inputs mainly help global movement prediction rather than detailed local pose prediction.
Critical weaknesses
-
Lack of technical novelty. The paper does not propose a new forecasting architecture, temporal alignment mechanism or intention representation. The technical contribution mainly consists of controlled ablations, window sweeps, subgroup analyses, and oracle probes using existing forecasters.
-
Insufficient evidence for the gaze-to-motion lag claim: The paper claims that the gain peaks when the input and output windows cover the gaze-to-motion lag and the prediction-effectiveness lag. However, it does not directly measure either lag.
-
Gaze and scene contributions are not separated: For C3 and C4, the egocentric input contains both gaze points and a scene point cloud. The reported gain therefore measures the joint contribution of gaze and scene geometry.
-
The consistently small effect is primarily observed for Local MPJPE, which remains below 3% in all configurations. The evidence therefore supports the more specific conclusion that egocentric inputs provide small improvements in local articulation but highly variable improvements in global trajectory prediction.
-
Paper writing, the presentation could also be improved: the oversized full-page table is visually overwhelming and contributes limited additional insight relative to its substantial space cost.
Questions for authors
-
Have the authors directly measured the gaze-to-motion lag in each dataset? Why should the performance-maximizing window be interpreted as evidence of a behavioral lag?
-
Can the authors isolate the effect of window length on GIMO using the same architecture, sampling rate, input modalities, and training protocol?
-
Can the authors report separate pose-only, pose-plus-gaze, pose-plus-scene, and pose-plus-gaze-plus-scene results for C3 and C4?
-
Are the state- and joint-specific effects statistically stable across subjects and random seeds? Can the authors provide confidence intervals and paired statistical tests?
-
Since the EgoBody oracle is derived from future ground-truth motion, how do the authors distinguish information insufficiency from the expected benefit of supplying a compressed representation of the prediction target?
-
Since no oracle reliably improves GIMO, what positive evidence supports the claim that its bottleneck lies in missing scene-navigation information rather than in model representation or optimization?
-
Can the authors evaluate a simple state-conditioned, joint-specific, or lag-adaptive fusion method to verify that the diagnostic findings translate into improved and more stable forecasting?
-
The authors suggest routing egocentric signals to specific motion states and joints. Could they implement a simple state-conditioned or joint-specific gating baseline to verify whether these analytical findings can translate into more stable improvements in forecasting performance?