- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes SANCTUARY, a safety-aware online RL fine-tuning framework for vision-language-action models. The method distinguishes between an original action-chunk proposal and its protected execution: a task critic and a safety critic learn from the original proposal, while hard constraints intervene during execution to prevent unsafe commands. SANCTUARY further combines a Risk Potential Field, a Latent Risk Monitor, and learned correlations for action-chunk exploration. The paper evaluates the method on LIBERO-Safety, twelve custom simulation scenarios, and one real-robot pick-and-place task, reporting improved task success and lower violation rates relative to several VLA and safe RL baselines.
Critical strengths
The paper addresses an important problem: reducing risk during online RL fine-tuning of VLA models. Its central design distinction between the original action proposal and the protected executed action is well motivated. By retaining risk feedback for proposals that are blocked by the execution-time safety mechanism, the method aims to avoid treating a prevented hazardous action as evidence that the proposal itself was safe.
Critical weaknesses
-
The empirical evidence is currently incomplete and insufficient to fully support the paper’s main effectiveness and safety claims. The paper explicitly states that simulation sample counts, training seeds, and uncertainty estimates remain to be reported. It also acknowledges that the correspondence between the baseline protocols used in the main comparison and ablation tables remains to be verified, and therefore differences across these tables should not be interpreted. Without these details, it is difficult to assess the reliability of the reported performance margins, safety improvements, and zero-violation results.
-
Figure 3 is presented as a trajectory analysis, but the paper explicitly describes it as a schematic illustration rather than measured training trajectories or collision statistics. It therefore helps explain the intended mechanism, but does not provide empirical evidence that SANCTUARY produces safer exploration during training.
Questions for authors
-
Could the authors provide the simulation sample counts, number of training seeds, and uncertainty estimates for Tables 1 and 2, and clarify whether the main-comparison and ablation results use comparable evaluation protocols?
-
Could the authors provide measured training-time safety evidence, such as violation counts, protective-intervention rates, or clearance statistics across multiple seeds, rather than only the schematic illustration in Figure 3?