- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes G2P-WAM, a post-training framework connecting geometric representation learning with preference alignment for world-action models. GeoSFT supervises WAM video representations using static VGGT features and dynamic motion targets from SpatialTrackerV2. A diagnostic stage evaluates geometric scores against execution outcomes on imagined and observed videos, selecting 4RC point confidence for trajectory filtering. GeoDPO then uses outcome-ordered, confidence-filtered pairs for reference-anchored preference training. Experiments report modest aggregate improvements on simulation benchmarks and a larger average gain over GeoSFT on three physical-robot tasks, without adding inference-time modules.
Critical strengths
-
The framework explicitly separates geometric supervision, score diagnosis, and preference construction. Using execution outcomes to determine preference order and reconstruction confidence to filter candidates avoids treating geometric plausibility alone as evidence of task success.
-
The ablations compare static-only, dynamic-only, and joint geometric supervision, and include a count-matched outcome-only DPO control. These comparisons provide targeted evidence for the contributions of joint supervision and confidence-based selection.
-
Evaluation covers simulation benchmarks, video-quality benchmarks, and physical-robot tasks. On the three PiPER X tasks, preference alignment improves average success from 77.8% to 85.6%, while deployment requires no geometric teachers, reconstruction scorer, or reference model.
Critical weaknesses
-
The main GeoSFT calibration uses 122 rollouts from a single task, while the same confidence-filtering direction is applied across tasks. Given the task- and policy-dependent score behavior reported in the diagnostics, the reliability of this selection rule across the target rollout distributions remains insufficiently established.
-
The gains attributable to the key components are modest on RoboTwin. Joint GeoSFT exceeds dynamic-only supervision by 0.06 percentage points, and confidence-filtered GeoDPO exceeds count-matched outcome-only DPO by 0.31 points. Although bootstrap intervals are reported for the full GeoDPO-stage improvement, the stability of these component-level gains across training runs is not established.
-
The preference-data construction is not fully quantified. Per-task rollout counts, success/failure pool sizes, and training-pair counts are not clearly reported, making it difficult to assess data coverage, trajectory reuse, and the execution cost required to reproduce the preference-training stage.
Questions for authors
-
The count-matched comparison supports the usefulness of confidence filtering. However, Appendix A.13 also shows that filtering changes the estimated pose-motion distribution. Does reconstruction confidence provide additional benefits over selection based on this motion proxy? A comparison under matched pair counts and training settings would help clarify the contribution of the geometric score.
-
How does GeoSFT compare with continued SFT using only the original flow-matching objective under the same data and training budget? Since A0 is the official checkpoint without additional training, this comparison would help separate the benefit of geometric supervision from that of further fine-tuning.