- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work focuses on the problem of collision risk mitigation in world-action models. The authors propose a method for monitoring the risk level in the world-action model and then steering the language instruction with a fixed warning text if the risk is above a threshold. The paper presents empirical evaluation on the LingBot-VA and the SafeLIBERO dataset suite, demonstrating reduced collision rates.
Critical strengths
This paper considers an important problem of preventing world-action models from executing unsafe actions. The authors propose an interesting method for steering the language inputs to include a fixed warning prompt to help reduce the collision rate.
Critical weaknesses
- As the authors write in the limitations, “[e]valuation uses LingBot-VA on seen SafeLIBERO tasks in simulation with one hand-written warning.”
- This work does not explore the language steering (with appended warnings) in sufficient detail. This makes the empirical findings quite weak and insufficient.
- It is unclear how well the method generalizes to unseen tasks.
- The paper only focuses on a single mode of safety, namely collisions.
- There are many other forms of unsafe behavior that are not captured in the empirical study. The warning, as well, only focuses on collisions with obstacles, thus further limiting the impact of this work.
- Some figures/tables are not very helpful or clear.
- In Figure 3, can you explain what the table exactly means? I understand that there is an alpha chosen for each split, but I’m not sure what value the table brings other than showing that each unsafe recall matches the target (1-alpha), which was by design?
- Some baselines are not properly explained:
- What exactly is the rotation variance baseline?
- What exactly is the time index baseline? How is it implemented? Is it just a single scalar dimension?
- How was the N = 4 chosen for Best-of-N? Why not higher N?
Questions for authors
- How does the method perform on other world-action models (such as Cosmos policy) and on datasets beyond SafeLIBERO (such as the vanilla LIBERO, LIBERO-plus, LIBERO-pro, etc)?
- Can the method generalize to other modes/risks of safety concerns?
- Can you show that the risk head has lower risk prediction with the steered language than without? This would isolate the effects of steering in appropriately reducing collision rate.
- Can you address the concerns about the clarity of figures/tables above?
- Can you provide answers to the following on the baselines? (Copied from the Weaknesses)
- What exactly is the rotation variance baseline?
- What exactly is the time index baseline? How is it implemented? Is it just a single scalar dimension?
- How was the N = 4 chosen for Best-of-N? Why not higher N?
Thank you for the detailed review.
Backbones and safety scope. Obstacle collisions are a central safety concern in robot manipulation and the specific hazard we study. The revision adds experiments with a second backbone alongside LingBot-VA.
Recall and false alarms. We clarify that 1-alpha sets the nominal recall target. Table 2 reports the recall measured on held-out unsafe chunks. Figure 3 shows how often the same thresholds flag safe chunks. An always-alarm rule, for example, achieves full recall and flags every safe chunk.
Baseline definitions. Rotation variance sums the sample variances of rotation coordinates over the chunk horizon across four draws. The time-index baseline uses the scalar t/T, the chunk index divided by the episode horizon. Best-of-N selects the lowest-risk candidate under a fixed budget of four.