acceptodds
Desk rejected at ICLR 2027

Recovering the View: Benchmarking Physical Active Vision for Occlusion Recovery in Robotic Manipulation

Desk rejected at ICLR 2027, so left out of the paper lists and the map.

Abstract

Physical active vision allows robots to change their viewpoint when task-relevant observations become unreliable, yet existing manipulation benchmarks provide limited support for studying how policies recover from occlusion during execution. We introduce a bimanual active-vision benchmark that systematically controls external visibility through Clean, Stage Occlusion, and Random-time Occlusion conditions, enabling evaluation of both manipulation performance and active visual recovery. Building on this setting, we present A-FAR (Active Future-Aware Recovery), an active-vision policy for joint viewpoint and manipulation control. A-FAR represents moving-camera observations in a unified robot-centric 3D frame and distills relational structure together with its future evolution from a pretrained 4D model, providing the policy with future-aware geometric guidance without requiring future observations at deployment. Experiments across multiple bimanual manipulation tasks show that A-FAR improves robustness to both structured and temporally shifted occlusions while maintaining strong performance under clean observations.

Primary area:
applications to robotics, autonomy, planning
Keywords:
Physical Active Vision, Robotic Manipulation, Occlusion Recovery, Imitation Learning, 3D Visuomotor Learning

Related papers

Discussion (0)

Sign in to comment.