- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FutureD4RT, a motion world model that predicts future 3D geometry in the feature space of frozen 4D reconstruction models. It uses a delta tokenizer to compress state transitions, a transformer to predict future tokens, and the frozen reconstruction decoder for geometric readout.
Critical strengths
- Leveraging pretrained 4D reconstruction models for motion forecasting without additional 3D trajectory annotations is an interesting direction.
- The compact delta-token representation and trajectory-based steering mechanism are interesting. The experiments demonstrate that the learned features capture meaningful motion information.
Critical weaknesses
The main limitation is that the proposed method does not demonstrate effective forecasting from observed frames alone. Its performance is comparable to holding the last position and worse than simple damped velocity extrapolation. The positive results largely rely on full-clip context, where the bidirectional encoder has access to future frames.
Questions for authors
Same as Weakness 1. Given that the method fails to outperform simple motion extrapolation under observed-only inference, what evidence supports its effectiveness as a future motion forecasting model? Could the authors address the train-test discrepancy caused by full-clip encoding?