- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
EgoAct4D estimates bimanual hand motion from egocentric video using separate hand and camera estimators. It emphasizes absolute hand placement and short trajectories without ground-truth alignment. The paper evaluates on HOT3D and a newly collected EgoAct4D dataset, with data-scaling, architecture and inference ablations.
Critical strengths
- The HOT3D results show improvements in absolute hand placement and action trajectories, including the broader evaluation with out-of-view states. These metrics are relevant to using reconstructed motion as action supervision.
- The pipeline is practical. Prediction reuse and camera stitching improve throughput, and the paper includes useful camera-source and data-scaling experiments.
Critical weaknesses
- External validation is limited to HOT3D. The additional EgoAct4D experiments are useful, but do not replace evaluation on another established benchmark or transfer to an unseen dataset. This leaves robustness across capture conditions, subjects and interaction types insufficiently demonstrated.
- The construction of EgoAct4D is insufficiently documented. Section 4.3 and Appendix C.1 describe its composition and splits, but do not explain how the 3D hand and camera ground truth was obtained or independently validated. Without the capture setup, annotation pipeline and label accuracy, the reported near-centimeter errors are difficult to interpret.
- The contribution relative to existing geometry-based and world-space hand reconstruction is not sufficiently isolated. The hand-encoder ablation compares DA3 initialization with a generic ViT and Qwen3-VL, but not other geometry-pretrained alternatives such as MapAnything or VGGT-Omega. It is encouraged to test these pretrained models that supply strong geometric cues.
Questions for authors
please clarify concerns raised in the weaknesses section.