- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The proposed method, named CAD-WAM, generates hand trajectories from an initial egocentric image, a language instruction, and an initial contact atlas. It combines a pretrained video model with an action-generation expert, then refines motion using predicted discrete contact codes for six anatomical hand regions. An asymmetric attention mask allows auxiliary video supervision while restricting the refinement branch’s access to future-video tokens.
Critical strengths
-
The reported trajectory accuracy is strong. In detail, Table 1 reports MPJPE reductions of 39.3% on HoloAssist and 44.9% on ARCTIC relative to the best listed baseline. Improvements also appear in articulation and rotation metrics.
-
CAD-WAM proposes an useful anatomical representation. Regional contact codes provide a plausible intermediate representation between task instructions and finger coordination.
-
The resaerch topic is hot and meaningful. Introducing WAM into dexterous hand manipulation generation is promising in this area.
Critical weaknesses
-
The central contact claim lacks direct validation. Pseudo-contact labels are derived from 2D hand–object overlap, which does not establish physical 3D contact. The paper does not quantitatively establish contact-code prediction quality or resulting contact accuracy. THe lack of object geometry at inference does not preclude object-aware evaluation where annotations are available.
-
The pipeline may be fragile. In detail, the entire anatomical contact atlas (ACAE) depends on pseudo contact labels obtained from HaMeR results plus SAM2 segmentation, rather than physical contact measurements from dedicated sensors. The whole contact-code learning pipeline is contaminated once hand reconstruction fails. The paper only briefly acknowledges this risk and provides no perturbation experiments under reconstruction noise, so the model’s tolerance to hand-registration errors is unknown. Inference requires high-quality hand reconstruction on the first frame, which strongly limits practical applicability.
Questions for authors
- Only hand-pose metrics are evaluated, and contact quality metrics (e.g., contact F1) are absent.