acceptodds
Under review as a conference paper at ICLR 2027

Vector-Symbolic Object Representations for Causal World Models

Abstract

World models forecast latent states by learning an internal representation of an environment's dynamics. Object-centric variants factor that state into per-object slots, but a slot is an opaque learned vector that requires a trained probe to read, and only supports some edits. We replace the learned slot with a vector-symbolic expression that pairs an object's identity with an encoding of its position, and predict with a graph network over these newly defined slots. Reading a slot, editing a scene and forming the relative position of two objects all become fixed algebraic operations with no trained parameters, and the interaction between any two objects can be toggled inside the predictor. We compare this model with current state-of-the-art, including a coordinate GNN (ref) and C-JEPA on NRI spring-coupled particles and CLEVRER. Beyond single step accuracy, we evaluate the models on closed-loop rollout, recovery of the true coupling graph, and the consequence of removing an object in a setting where ground truth is available. Our model provides superior performance, scoring on rollout compared to ballistic constant velocity prediction versus (coord-GNN) and (C-JEPA), and recovers the coupling graph at ROC-AUC against (coord-GNN) and (C-JEPA).

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.