- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how to learn from “last-mile” failures in fine-grained robotic manipulation, where failed trajectories share most of their motion with successful demonstrations but deviate near task-critical contact. It proposes CALM, a world action model trained with success, failure, and null outcome tokens using one binary label per trajectory. At inference, contrastive denoising guidance steers action generation toward success and away from failure; the default configuration combines only the success and failure predictions because the null term cancels. The paper also presents an empirical audit of failure trajectories and a theoretical analysis explaining when the success–failure contrast aligns with task-critical corrections. On six real-robot tasks, CALM achieves 77.2% average success, outperforming the strongest standard baseline by 12.8 percentage points. Ablations examine guidance components, label granularity, and failure quality, showing that the benefit diminishes when failures deviate substantially from successful motion.
Critical strengths
-
The paper identifies last-mile failures as a substantial source of supervision: 96.2% of procedure-complete failures in its main audit share most of the successful motion, with supporting evidence across operators and a public dataset. This grounds the method in an observed property of robot data and motivates retaining demonstrations that would otherwise be discarded.
-
The theoretical analysis unifies outcome-guidance rules as gains along one success-failure contrast direction and gives a sufficient alignment condition under a local residual model. This provides a testable explanation of when failure guidance should be useful, beyond introducing another guidance formula.
Critical weaknesses
None
Questions for authors
-
Have you compared CALM with complete training implementations of closely related outcome-guidance methods, rather than only applying their guidance rules to CALM checkpoints? Such results would help distinguish the contribution of CALM’s training procedure from its inference weights.
-
How much manual effort and task-specific knowledge are needed to audit a new dataset? What evidence shows that this audit can predict, before training CALM, whether a failure pool will provide useful guidance?
Thank you for the detailed response, which addresses most of my previous concerns. I maintain my score.