CarPhy: A Carrier Physics Aware Pose Correction Agent for Interactive World Models

Interactive world models (IWMs) generate virtual environments that evolve in response to user actions, enabling users to explore and interact with generated worlds. However, they can overlook physical interactions between the camera carrier and the surrounding environment, producing implausible motion such as passing through solid walls. To address this issue, we propose CarPhy, a pose correction agent that explicitly models Carrier Physics to calibrate IWMs to generate plausible videos. Since different scenes require different physical interpretations and modeling steps, CarPhy equips the agent with multimodal scene and carrier context, along with tools for semantic analysis, world editing, and motion rollout. Guided by this context, the agent adaptively selects and combines tools to determine how the environment affects the carrier and simulate the resulting motion. We further construct a test set spanning diverse terrain and obstacle configurations to evaluate physical event recognition and pitch-response timing. Experiments demonstrate improved physical event recognition and more accurate pitch-response timing across multiple VLM and LLM backbones.