acceptodds
Under review as a conference paper at ICLR 2027

What Is Identified in Causal Representation Learning? Exact Answers for the Normalized iVAE from Realized Symmetries

Abstract

Causal representation learning shows that a latent representation can be recovered only up to a symmetry. This leaves a question unanswered: which claims about hidden causes are fixed by observed data? We introduce a framework that answers it by characterizing functions of latent variables that are determined by observations and unchanged by symmetries. We first show why normalization is essential: a class that admits monotone changes of every latent coordinate identifies only constant functions. For the normalized iVAE with scalar statistics and a fixed latent parameterization, we build changes of variables that realize every range-preserving permutation and sign change. This turns the classical iVAE inclusion into an exact statement within each set of models producing the same observations: the bounded functions unaffected by those permutations and sign changes are identified. We show how these statements fit together across model classes. A rigid class preserves content, while a class allowing monotone changes in every coordinate reduces it to constants. Finally, we show how contrastive content and style separation fits the same interface and sketch how CITRIS fits the picture. Experiments with fitted iVAEs show that the symmetry is real in practice, that identified functions are the stable ones across retraining, and that a stronger normalization restores individual coordinates.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.