- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a safety filter for robotic manipulation. The core idea is simple: the predicted action is fed into an action condition world model which generates several visual futures. These are then fed into a classifier which determines if it represents a safe or unsafe rollout. In addition a more classic based safety filter is included which in parallel checks for joint and workspace violations. The filter is evaluated offline in simulation on several tasks. The world model future based safety filter catches a relatively small amount of safety violations, while the classical safety filter catches the majority of the safety violations.
Critical strengths
Robotic safety is an important area of research. This paper tackles a difficult problem of predicting failures before they happen using world models. This is a task that humans often do during manipulation and a robust system that can predict the effects of its actions on the environment and change them accordingly is important.
Critical weaknesses
Experiments are only conducted in simulation on a small number of tasks. Similar related work conducts experiments in the real world Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures (Seo 2026), FOREWARN (Wu 2025).
I feel this paper generally offers limited novelty over prior work. Several papers are conceptually very similar including Latent Safety Filters for Avoiding Out-of-Distribution Failures (Seo 2026) (which is not cited) and FOREWARN (Wu 2025). At the very least prior related work which solves a similar problem should be included as baselines to the method. Additionally I feel it would make the paper stronger to also include linear probes on activations to detect unsafe behavior as a baseline. I find the motion safety monitor aspect of this paper to be a relatively minor contribution.
Examining the results in Table 2. It appears that the WM proposed method has a recall of only 4.67% of unsafe behavior at three predicted futures and 7.33% at five futures, while the motion safety monitor has a recall of 54.95% of unsafe behavior. This to me indicates that the proposed world model method does little to detect unsafe behavior.
Questions for authors
What is the nature of the world model ? Is it fine-tuned from an existing world model or simply running forward the environment you are using on several action generations ? As far as I can tell the world model being used is never explained.
How do you differentiate yourself from prior work like Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures (Seo 2026) and why is it not included as a benchmark ?
Is there any rebuttal for this paper?
I think it would be nice to discuss in any case this paper.