- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents CAFE-VLA, a controllable obstacle-avoidance framework for compact Vision-Language-Action (VLA) models. The method introduces a continuous avoidance-strength scalar and an end-effector-centric 3D geometry field to guide action generation. The scalar is incorporated through FiLM, while the geometry field is injected via sparse cross-attention and visual prompting. Experiments on SafeLIBERO and real-world robotic manipulation demonstrate improved obstacle avoidance while largely preserving the original manipulation capabilities.
Critical strengths
-
Practical Motivation. The paper addresses an important problem in robotic manipulation: enabling VLA models to adapt their obstacle-avoidance behavior to different safety requirements.
-
Simple and Effective Design. The proposed framework integrates continuous avoidance control and explicit geometric guidance into a compact VLA model with limited parameter overhead. The experimental results demonstrate its effectiveness in improving obstacle avoidance while maintaining task success.
-
Comprehensive Experimental Validation. The paper provides extensive experiments across different safety levels, including detailed ablation studies and real-world evaluations. The results consistently support the effectiveness of the proposed components.
Critical weaknesses
-
Joint Training and Capability Preservation. Although the paper evaluates capability retention on the original LIBERO benchmark, it remains unclear whether jointly training on the original LIBERO data and the newly generated obstacle-avoidance demonstrations could further improve the performance trade-off. The authors are encouraged to investigate different data-mixing ratios and examine whether the proposed method can maintain its avoidance capabilities while better preserving general manipulation performance.
-
Data Construction and Scalability. The proposed method requires additional obstacle-avoidance demonstrations and a geometric annotation pipeline to construct the training conditions. While the avoidance-strength labels can be generated automatically, the overall data preparation process introduces additional complexity. It would be valuable to further discuss how this pipeline could scale to larger and more diverse robotic datasets, particularly in real-world and zero-shot settings.
-
Generalization Across VLA Backbones. Although the paper includes comparisons with several safety-aware methods, the proposed framework is primarily evaluated on SmolVLA. It would be beneficial to further validate its effectiveness on stronger VLA architectures, such as π0.5 and VLANeXt, under comparable training and evaluation settings. Such experiments would provide stronger evidence of the method's general applicability.
-
Extension to World Action Models. The proposed framework may also be applicable to emerging World Action Models (WAMs). The authors are encouraged to explore its effectiveness on representative WAM architectures, such as Fast-WAM. This would help assess whether the proposed conditioning strategy can generalize beyond conventional VLA models and improve obstacle avoidance in world-model-based action generation.
Questions for authors
See weakness.
Response to Reviewer bkui Part 1 Controllability Action Aggregation and Perception
Thank you for the exceptionally detailed deployment-oriented review. We appreciate that you asked where controllability breaks, whether geometry remains causally aligned with executed actions, and how the system behaves under missing perception. Following your suggestions, we added complex-layout sweeps, causal aggregation replay, perception-corruption tests, and collision diagnostics.
Q1. Cross-task controllability
On full SafeLIBERO, including multi-obstacle and narrow-passage scenes, can the authors report per-task intensity–distance relationships, monotonicity-violation rates, and the extrapolation range over which task success is sustained?
A1. Controllability across tasks and complex scenes
We agree that a global statement such as s≤15 requires task-wide support. We therefore run the full strength sweep on all 16 SafeLIBERO tasks and on multi-obstacle and narrow-passage variants.
The released and complex layouts obtain macro strength–clearance correlations of 0.946 and 0.962, respectively. Completion remains stable through s=15 on released layouts and s=14–15 on complex layouts, while clearance remains monotonic through s=17–18 and s=16–18, respectively.
Rather than reducing non-monotonic behavior to a single violation count, we report the last strength level up to which the relationship remains monotonic for each task. The results support broad but bounded controllability: complex geometry preserves the strength ordering but can shorten the usable range.
Revision location: Sec. 4.7 and Appendix B.1, Table 14 and the per-task controllability figure.
Q2. Sensitivity of look-ahead probes to prediction error
Can the authors compare fields built from demonstration, policy-predicted, and temporally aggregated actions, and test whether training perturbations match observed action errors?
We clarify that no current predicted action exists before the current action is generated. Using a not-yet-generated action to construct its own conditioning would create a non-causal circular dependency.
A2. Causal action aggregation and prediction error
Demonstration actions are available during training, whereas deployment must construct the geometry field before the current policy call. A current or future predicted action therefore cannot condition its own generation. We instead use a causal replay protocol containing only information available at deployment time.
Before the current policy call, we compare the raw execution queue with the temporally aggregated predictions already available. After the new action chunk is generated, we compare the geometry fields and action directions before and after updating the aggregated queue.
The deployment discrepancy is measured directly and is largely covered by the training perturbation distribution. We also clarify that no same-step post-inference action constructs its own conditioning field.
Revision location: Appendix B.2, Table 15.
Q3. Unknown geometry
When obstacles are missed, depth is absent, or geometry is occluded, does encoding distance as the maximum range compromise avoidance, and can the authors test perception degradation and report arm and manipulated-object collisions?
A3. Missing depth, unknown geometry, and arm collision
We agree that encoding unknown space as far away is unsafe unless stress-tested. We therefore evaluate 10% and 20% mask dropout and depth holes. The uncorrupted CAR/TSR is 80.25/68.63%.
At 20% corruption:
The fallback does not reduce every collision metric simultaneously. Under 20% mask dropout, arm collision changes from 5.43% to 5.64%, although end-effector collision and overall CAR/TSR improve. This indicates that conservative fallback can redistribute contact across body parts. We therefore report end-effector, arm, and manipulated-object collisions separately and describe unknown-as-occupied as a conservative fallback rather than a universal solution.
Revision location: Appendix B.3, Table 16, and Appendix A.5.