- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies concept supervision in the latent representations of DreamerV3, using Craftax-Classic as the experimental environment. The authors assign 14 human-defined concepts to designated latent coordinates and investigate whether these concepts remain predictable from the rest of the representation. They compare direct coordinate supervision, additional localization regularization, an ablation-based objective, sparse autoencoders, and a self-ablation baseline.
Critical strengths
The paper investigates an interpretable representation problem in model-based reinforcement learning. The paired-checkpoint experimental setup and per-concept analyses provide some useful descriptive observations about how different regularization objectives affect concept readability.
Critical weaknesses
The paper revisits well-established questions in supervised disentangled representation learning for a specific world model. The observation that supervising individual latent coordinates improves their predictability of predefined concepts, while the same information remains recoverable from other dimensions, is largely expected given the extensive prior literature on disentanglement and distributed representations.
Similarly, the distinction between concept decodability and causal usage has been studied extensively in interpretability and probing research. The analytical example in Figure 1 is a straightforward construction illustrating this known distinction rather than a substantial new theoretical result
All experiments are conducted on a single environment (Craftax-Classic) and a single model architecture (DreamerV3), using only 14 supervised concepts and five starting checkpoints. The results therefore provide limited evidence about the generality of the observations.
Given the limited novelty and narrow empirical scope, the contribution does not appear sufficient for ICLR.
Questions for authors
N/A