SAGE: Subgoal-Conditioned Action Generation for Latent World Model Planning
Abstract
Latent world models have emerged as a powerful planning paradigm by learning action-conditioned predictive dynamics and using them as internal simulators to imagine and evaluate candidate action sequences. However, as the planning hori zon grows, performance becomes increasingly constrained by proposal quality: a fixed candidate budget must search an exponentially larger action space, making it difficult to expose the world model to high-quality candidate futures for evalua tion. In this paper, we introduce SAGE, a prior-conditioned planner that replaces random proposal initialization with structured guidance. At each planning stage, a goal-conditioned generator predicts the next intermediate latent subgoal for a specified duration, which is then used to condition the generation of candidate action sequences. To capture semantic information across temporal scales, we use subgoals of varying durations as priors, balancing fine-grained local control with higher-level long-horizon progress. Then the frozen world model evaluates these proposals against the same subgoal and guides their refinement before ex ecution. Experiments on PushT and OGBench Cube show that coupling latent subgoal decomposition with prior-conditioned action generation substantially im proves long-horizon planning while preserving strong short-horizon performance. To be specific, when the target offset is 150, it raises PushT success from 4.7% to 64.7% and OGBench Cube success from 20.7% to 67.3%. We further extend latent world-model planning to LIBERO, where SAGE improves full-episode success from 0% with the vanilla LeWM planner to 48.7% on Scene2 and 58% on Caddy.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.