- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes CoGeo-WAM, a framework for incorporating and controlling geometry-related adaptation in pretrained world action models. After calibrating an alignment projector, the first stage trains LoRA residuals using video and action objectives together with feature alignment to a frozen VGGT teacher. The second stage freezes these residuals and learns a controller that modulates their contributions using intermediate hidden states, block identity, and flow time. Evaluation covers LingBot-VA on RoboTwin 2.0 and FastWAM-Joint on LIBERO and four real-world Franka manipulation tasks.
Critical strengths
-
The problem is well motivated, and the adaptation interface is practical. Table 4 shows that uniform geometry adaptation can help some tasks while hurting others, motivating control over the learned residual. The framework preserves the original input modalities and does not require VGGT or explicit geometric inputs at inference. The measured memory increase is below 1% for the LingBot-VA configuration (Tab.6), supporting its practical appeal.
-
The evaluation includes meaningful manipulation settings. The experiments cover two WAM implementations, two simulation benchmarks, and physical execution on a Franka robot. The real-world tasks include cup nesting, sequential block stacking, and pouring, providing useful evidence of applicability to different interaction requirements.
Critical weaknesses
-
The paper does not sufficiently establish what geometric capabilities are learned or how they explain the policy improvements. The appendix gives plausible descriptions of spatial localization, gripper clearance, and contact requirements, but these descriptions are not independently tested. Specifically
- Fig.4 measures how well features from the frozen original WAM can be mapped to VGGT features; it supports layer selection rather than demonstrating improved geometry after adaptation.
- Fig.5 illustrates gate variation during one task, without establishing that the variation responds to geometric demands or causes better execution.
- Tab.5 measures RGB prediction quality rather than specific 3D capabilities. Moreover, the Stage-I residual is jointly optimized with video, action, and alignment losses, so its benefits cannot be attributed specifically to geometry without a matched no-alignment control. These gaps leave the connection between task requirements, acquired geometry, and policy advantages unclear, limiting the insight provided by the central geometry-aware framing.
-
The incremental value of the more involved training pipeline over related approaches is not sufficiently demonstrated. For example, the aggregate number of real-world successes increases only from 62/80 to 67/80. With just 20 trials per task, this gain is too small to be meaningful.
Questions for authors
-
What specific geometric capability improves after adaptation? Could you provide a focused probe, controlled spatial variation, or failure analysis that links this improvement to a relevant manipulation requirement, beyond VGGT feature similarity and overall success rate?
-
How does the full method compare with the same LoRA/controller procedure without geometric alignment, and with static learnable block-wise gates trained under a matched budget? Is there a real-world Uniform Geometry comparison, particularly on Block Stacking, that clarifies the contribution of dynamic control?
-
Please specify the LoRA rank, scaling and insertion modules, controller architecture, and data and optimization budgets for projector calibration and both training stages.