- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes GeoLACE, a framework that integrates geometric features from pretrained geometric foundation models into VLA policies. The method introduces ActSelect to identify complementary geometric features and action-relevant VLA layers, followed by layer-wise feature fusion and a two-stage training strategy to preserve pretrained vision-language capabilities. Experiments on LIBERO, RoboTwin, and real-world robotic systems demonstrate improvements in manipulation performance.
Overall, it presents a well-motivated approach to incorporating geometric priors into VLA models, supported by extensive simulation and real-world experiments. Therefore, I support the acceptance of this paper.
Critical strengths
-
The proposed action-conditioned layer selection provides a systematic way to integrate geometric features into VLA models, and demonstrates improvements across multiple benchmarks and two real-world robotic platforms, supported by ablation studies on layer selection, feature fusion, and training strategies.
-
The paper evaluates the preservation of pretrained vision-language capabilities through GQA experiments, addressing an important concern when incorporating geometric features into VLA models.
Critical weaknesses
- The method relies on online VGGT features and uses feature caching to reduce inference latency. However, it remains unclear how cached geometric features affect performance in dynamic scenes where objects or robot viewpoints change rapidly.
Questions for authors
-
Could the authors compare the proposed CKA-based GFM source-layer selection with simpler strategies, such as random or uniformly spaced layer selection, under the same training settings?
-
How sensitive is the proposed method to the geometric feature refresh frequency during real-world execution? Could the authors further analyze the trade-off between inference efficiency and manipulation performance?
2 comments
Response to Reviewer 7UT9 (2/2)
[Q1] Could the authors compare the proposed CKA-based GFM source-layer selection with simpler strategies, such as random or uniformly spaced layer selection, under the same training settings?
Response: Yes. We have added uniform and random source-selection comparisons. Specifically, under the same branch count, VLA mapping, training data, training budget, and Safe-Add schedule, CKA-based selection achieves 98.1% average LIBERO success, compared with 97.4% for uniform selection and 97.2% for random selection, and performs better on all four suites.
Additional controlled comparison. We compare the three source-selection strategies while keeping the three fusion branches, VLA mapping (1, 7, 9), training data, training budget, and Safe-Add schedule fixed.
| Source selection | Source layers | Average LIBERO success (%) |
|---|---|---|
| Uniform | (6, 12, 18) | 97.4 |
| Random | (4, 10, 12) | 97.2 |
| CKA-based | (8, 16, 21) | 98.1 |
Analysis. The CKA analysis identifies three representational stages: layers 0–13, 14–17, and 18–23. Uniform selection omits the middle stage, while random selection remains entirely within the first stage. CKA-based coverage of all three stages provides a mechanism consistent with the observed downstream gains; equal spacing in layer indices does not ensure such coverage.
We have added the complete per-suite results and this analysis to Appendix A.1 (GFM Source Selection), Table 5.
[Q2] 2.1 How sensitive is the proposed method to the geometric feature refresh frequency during real-world execution?
Response: Our additional comparison shows a modest success increase from 74.4% with asynchronous 2 Hz refresh to 76.9% with synchronous encoding targeting 10 Hz, while mean latency rises from 90.8 to 169.1 ms per action chunk.
Additional experiment. To examine sensitivity to geometric feature updates during real-world execution, we compare our default configuration, which reuses features with scheduled asynchronous 2 Hz VGGT refresh, against synchronous encoding targeting 10 Hz. In the synchronous configuration, every policy request waits for VGGT features computed from the current observations before VLA inference proceeds. In the default configuration, policy requests arrive at approximately 10 Hz and reuse geometric features refreshed asynchronously at a scheduled rate of 2 Hz, with visual changes able to trigger earlier updates. The VLA continues to receive current RGB observations and proprioception. Each configuration is evaluated over 40 trials on each of the four Setting A tasks.
| Task | Async. (2 Hz) success ↑ | Sync. (10 Hz) success ↑ | Async. (2 Hz) latency (ms) ↓ | Sync. (10 Hz) latency (ms) ↓ |
|---|---|---|---|---|
| Starfruit handover | 31/40 | 33/40 | 104.3 | 167.2 |
| Rag pickup | 37/40 | 36/40 | 81.7 | 168.7 |
| Item packing | 32/40 | 33/40 | 86.7 | 171.4 |
| Phone placement | 19/40 | 21/40 | 90.6 | 168.9 |
| Overall | 74.4% | 76.9% | 90.8 | 169.1 |
[Q2] 2.2 Could the authors further analyze the trade-off between inference efficiency and manipulation performance?
Response: Yes. Our additional comparison with synchronous VGGT encoding targeting 10 Hz quantifies the efficiency–performance trade-off: asynchronous 2 Hz refresh reduces mean latency by 46.3%, with an observed decrease of 2.5 percentage points in success. This measured trade-off motivates our default asynchronous configuration.
Additional analysis. Across these two evaluated configurations, computing fresh geometry for every policy request provides a modest improvement in manipulation success but incurs substantially higher latency. Feature reuse avoids repeated geometric encoding, while asynchronous refresh reduces blocking; visual-change-triggered updates allow earlier refreshes when the scene changes.
We have reported this comparison and the reason for choosing the default configuration in Appendix D.4 (Table 15), together with the execution and visual-change-triggered refresh protocols. Reported latency includes all recorded requests, including cache initialization and requests involving geometric refreshes.
Response to Reviewer 7UT9 (1/2)
Thank you for your careful review and constructive suggestions. We appreciate your recognition of our systematic layer-selection approach, the simulation and real-world evaluations, and the assessment of pretrained vision–language capability preservation. Below, we address your concern and questions in the order raised and indicate the corresponding manuscript revisions.
[W1] The method relies on online VGGT features and uses feature caching to reduce inference latency. However, it remains unclear how cached geometric features affect performance in dynamic scenes where objects or robot viewpoints change rapidly.
Response: The original submission describes visual-change-triggered updates to reduce temporal mismatch; we now test the default feature-reuse configuration under dynamic perturbations. Specifically, GeoLACE achieves 70.6% overall success in Setting A and 60.0% in Setting B, with modest decreases from the original conditions while matching or exceeding π₀.₅ on all five tasks. Visual-change-triggered refresh ratios increase on every task, consistent with geometric updates responding to scene changes.
Evidence in the original submission. This aspect of feature reuse was partially discussed in Appendix D.4 of the original manuscript: the visual-change criterion compares current observations with those associated with cached geometry and can trigger an earlier update. Waiting for an ongoing refresh and rechecking the updated cache before synchronous recomputation are designed to reduce temporal mismatch.
Additional dynamic-scene experiments. We have added real-world dynamic-scene experiments and analysis in Appendix D.4 (Table 16), with a corresponding reference in Sec. 4.4. We evaluate GeoLACE using its default feature-reuse configuration. Both π₀.₅ and GeoLACE are evaluated over 40 trials per task under three types of perturbations:
The last two columns report visual-change-triggered refreshes as a percentage of total VLA policy requests for GeoLACE under the original and dynamic conditions.
Despite modest decreases relative to the original conditions in Table 4, GeoLACE maintains an overall advantage over the baseline in both settings. This advantage extends across object repositioning, rotation, and the introduction of additional objects, demonstrating effective manipulation when the scene changes during execution.
The visual-change-triggered refresh ratio increases on every task, indicating that geometric updates are triggered more often per policy request under dynamic conditions. The refresh criterion compares current observations with the reference observations associated with the cached geometry, tying update decisions to changes relative to the geometric features being reused. This enables updates in response to object motion and newly introduced scene content, helping reduce temporal mismatch during feature reuse. Together, the task results and observed refresh behavior support the effectiveness of the default feature-reuse configuration under the tested dynamic scene changes.