acceptodds
Under review as a conference paper at ICLR 2027

SPW-Nav: A Streaming Panoramic World Model for Language-Guided Navigation

Abstract

Language-guided panoramic video generation benefits various downstream applications, such as interactive 3D scene exploration, virtual reality experiences, and embodied agent training. Existing panoramic generators follow predefined trajectories, and interactive world models act through low-level actions in perspective views. We propose SPW-Nav, a streaming panoramic world model that understands movement instructions and streams one minute of 2K 360 video in real time from a single panorama. SPW-Nav interprets each instruction in the previously generated panorama as camera motion. Spherical rotation decoupling applies rotation exactly on the sphere, pose-aligned conditioning keeps translation inputs bounded over long streams, and a multi-term memory with a distilled few-step generator continues the scene as instructions change. We also build SPW-NavSet, panoramic videos with camera trajectories and verified instruction annotations. Driven by language, SPW-Nav outperforms existing panoramic generators in camera following and video quality, and supports on-the-fly instruction switching.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.