- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how to introduce geometric knowledge into VLMs and VLA policies while preserving their existing vision-language capabilities. GDA trains an auxiliary latent geometry branch using a frozen 3D teacher, retrieves geometry through cross-attention, and injects the resulting correction into RGB tokens through a per-channel gate. The external teacher is removed at inference. The paper evaluates both vision-language compatibility and manipulation performance, including LIBERO, RoboTwin 2.0, and four targeted real-world tasks.
Critical strengths
-
The compatibility-versus-geometry question is useful for generalist robot policies. Evaluating both VLM capabilities and downstream control makes the contribution more informative than reporting manipulation success alone. Relevant controls include capacity/no-distillation baselines, shuffled teacher targets, teacher swaps, and gate interventions. Spatial Forcing is already compared across VLM and robotic evaluations, with an additional distillation-weight sweep. The supplementary code and rollout examples also improve inspectability.
-
The reported manipulation gains are substantial in some matched settings. Table 2 reports 0.5B LIBERO average success rates of 86.3% for the reproduced base policy, 83.6% for Spatial Forcing, and 95.8% for GDA. Table 3 reports 49.4%, 58.8%, and 68.1%, respectively, across the targeted real-world conditions. These results constitute meaningful positive evidence within the evaluated settings.
Critical weaknesses
-
The specific mechanism contribution is not fully isolated by the ablations. Geometry distillation with teacher removal at inference is already established by Spatial Forcing, which the paper appropriately compares against. GDA's specific increment is the latent-branch/gated-fusion design, but a matched simpler channel gate or RGB-only-conditioned gate would help identify its independent benefit. Table 14's three-seed overall VLM improvement is not statistically detectable at that sample size, and the matched 7B LIBERO advantage over Spatial Forcing is only 0.1 percentage points. These limitations do not negate the larger gains in other settings.
-
The evidence for an advantage on the stronger pi0 policy is limited specifically on LIBERO. In Table 2, average success increases from 93.1% to 94.3% (+1.2 percentage points), mainly from Goal (92.0% to 96.2%); Object is unchanged and Long slightly decreases (85.6% to 85.4%). The high baseline leaves limited headroom, but Table 2 also lacks a matched pi0 + Spatial Forcing comparison, so GDA's incremental benefit over geometry distillation is not established in this setting. Spatial Forcing comparisons are provided for the pi0-based real-world experiments (Table 3) and RoboTwin (Table 18); this concern is specific to pi0-LIBERO.
Questions for authors
-
Can the existing ablations distinguish the proposed gate conditioning from a matched learned channel gate or RGB-only-conditioned gate? Please clarify what the evidence supports about the specific fusion mechanism, beyond the reported task improvements.
-
For pi0-LIBERO, are matched pi0 + Spatial Forcing results available under the same fine-tuning recipe? If not, please qualify the claim of an advantage over geometry distillation for this setting, and discuss the modest, Goal-concentrated gain and possible ceiling effects. This request is limited to the existing pi0-LIBERO setting.
-
The supplementary fusion paths appear to use different residuals. Which implementation corresponds to the reported experiments, and is the difference simply an outdated supplementary file? A version clarification would suffice initially; no full retraining is requested.