- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper identifies a failure mode in which latent world models retain static background variation while underrepresenting actionable dynamics. It proposes motion-guided contrastive regularization: optical-flow distances define soft targets over within-episode candidate transitions, and predicted latent changes are trained to match them. Optical flow is computed offline and is unnecessary during planning. Experiments include a controlled background intervention, planning benchmarks, physical-state probes, and matched contrastive ablations.
Critical strengths
-
The paired Cube/CubeRB intervention and state probes provide unusually direct evidence for the proposed diagnosis. Success changes from 52% to 78% on CubeRB, while robot-position probe error decreases from 13.01 to 3.56 cm. The clean Cube result changes only from 74% to 76%, supporting a targeted benefit under background distraction.
-
Table 3 compares motion targets with InfoNCE using the same candidate construction and latent scores. The proposed targets improve CubeRB/LIBERO success to 78%/54%, versus 56%/34% for InfoNCE. The shared planner and absence of optical flow at inference make this a useful training-time intervention.
Critical weaknesses
-
The statistical evidence is limited to 50 evaluation pairs per setting. LIBERO uses 50 pairs in total across ten tasks and a custom positional image-goal criterion; this is not equivalent to the original task predicates involving other state attributes. Per-task results, uncertainty estimates, and a clear account of initially satisfied Cube goals would better establish how broadly the reported gains apply.
-
The training cost and dependence on pretrained optical flow are insufficiently quantified. Inference timing omits flow precomputation and additional candidate encodings during training. The InfoNCE control establishes the benefit of motion-shaped targets, but does not determine whether the pretrained flow model is necessary relative to a cheaper motion proxy with similarly soft targets. These issues affect the practicality and interpretation of the intervention.
Questions for authors
-
Please report LIBERO results by task, clarifying the distinction between positional goal success and original task success. How do Cube/CubeRB results change when initially satisfied goals are excluded?
-
What are flow precomputation time, training wall-clock time, and peak memory relative to LeWM? Can a cheaper motion proxy with matched soft-target construction recover the gains?