- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper identifies a prediction–planning gap in latent world models where low prediction error on recorded transitions does not necessarily imply that the model will favor actions that achieve desired physical outcomes. The authors demonstrate that locally perturbed counterfactual actions can receive lower prediction errors than the factual actions while producing outcomes farther from the observed targets.
main contributations:
-
Identify and demonstrate the prediction–planning gap.This establishes that accurate forward prediction alone does not guarantee reliable action selection.
-
It augments the standard forward-prediction objective with a local factual–counterfactual comparison.
The authors evaluate ACA using LeWorldModel (LeWM) and Sensorimotor World Models (SMWM) across four simulated control environments: TwoRoom, Reacher, Push-T, and OGBench-Cube, including stricter evaluation protocols and limited-data settings.
Critical strengths
-
A simple and principled approach to mitigating the prediction–planning gap. The paper identifies a meaningful failure mode in latent world models, where counterfactual actions can receive lower prediction errors despite producing worse physical outcomes.
-
Consistent empirical improvements across diverse planning settings. ACA improves planning success across both LeWM and SMWM on four simulated environments, with particularly notable gains under strict evaluation, single-plan, and long-horizon settings.
Critical weaknesses
The main limitation is that the validation is conducted in simulated environments. The results establish promising evidence for improved model-based planning, but do not yet demonstrate transfer to physical robots or real-world deployment.
Questions for authors
- What is the overhead computation cost introduced during training,
- How sensitive are the improvements to the perturbation radius and ACA loss weight across different environments and action spaces?