- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes FAVOR, an execution verification and recovery framework for world action models. It retains the visual futures predicted before action execution and uses them as anchors for both detecting deviations and specifying recovery targets. A learned Anchor Verifier combines observation–prediction features, executed actions, and temporal information to identify deviations. Upon an alarm, a VLM translates the current observation and the retained anchor into a corrective instruction, which the frozen WAM executes with strengthened classifier-free guidance. Experiments on LIBERO and LIBERO-Plus show improved failure detection and modest increases in task success, from 97.85% to 98.10% and from 72.60% to 72.98%, respectively.
Critical strengths
- Reusing predicted futures as both verification references and recovery targets is intuitive and provides a coherent connection between failure detection and correction.
- The Anchor Verifier achieves strong detection performance on LIBERO, outperforming the evaluated distance-based and learned detectors.
Critical weaknesses
- The success-rate gains are marginal: only 0.25 percentage points on LIBERO and approximately 0.38 on LIBERO-Plus. No uncertainty estimates are reported to establish their reliability.
- End-to-end comparisons mainly involve internal variants of Fast-WAM-IDM. Comparisons with strong WAMs such as LingBot-VA and Cosmos Policy, as well as competing execution-monitoring methods, are missing. Cross-backbone generality is also untested.
- Simulation evaluation is limited to two closely related benchmarks, LIBERO and LIBERO-Plus. Additional benchmarks such as RoboTwin 2.0 would provide stronger evidence of generalization.
- No real-robot experiments are provided, leaving the effectiveness of verification and recovery under physical execution errors insufficiently validated.
- Episode-level detection metrics do not establish timely or effective recovery. Detection delay, successful rescue rates, and harmful intervention rates are not reported.
- The additional inference latency from verification, VLM calls, and strengthened CFG is not quantified, making the practical trade-off against the small success gains unclear.
Questions for authors
- Are the reported gains consistent across random seeds? Please provide confidence intervals or paired statistics on successful rescues and harmful interventions.
- How does FAVOR compare with LingBot-VA and Cosmos Policy under matched evaluation settings, and with execution-monitoring methods such as FFDC using the same backbone? Is there evidence that FAVOR also benefits another compatible WAM backbone?
- Do you have results on a more distinct simulation benchmark, such as RoboTwin 2.0, to assess generalization beyond the LIBERO task family?
- Do you have real-robot results demonstrating effective verification and recovery under physical execution errors and perception noise?
- How early are task-breaking deviations detected, and what fraction of triggered interventions ultimately rescues the task?
- What additional inference latency does FAVOR introduce, and how does it affect overall task completion time?