- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces a principled way of testing the Platonic Representation Hypothesis (PRH). The PRH states that sufficiently large and well-trained models converge to the same representation of the world. The authors claim that this phenomenon is always checked by assessing whether models align with each other, without any measure of alignment to the world. They address this limitation by using a set of simulated physical systems parametrized by a Hamiltonian with ground truth variables , from which text and video are generated in pairs coming from the same .
Video and text models are trained independently on each modality using two different regimes: generative task only, and generative training with an additional task that predicts the physical properties of the system. They vary whether the image and text models are trained to predict the same quantities, partially overlapping quantities, or different ones. They show that training the models with an additional task significantly increases their alignment, suggesting that for models to align, seeing the same « world » is insufficient to produce strong alignment, they must also be trained to predict information about it.
Critical strengths
- Making a controlled test for Platonic Representation is very interesting and, in my opinion, an important contribution: having a parameterized model of the world allows us to precisely measure the impact of the variables on alignment, distinguish whether alignment comes from shared information or a shared objective, and measure precisely which quantities promote alignment.
- Authors provide an extensive set of experiments to study in depth their proposed test for PRH. They provide ablations, study the impact of the prediction heads, compare to frozen pretrained encoders, and include several physical system families. The set of experiments supports the main findings well.
Critical weaknesses
- It is not certain that the text and video models considered here have the scale and competence to reach the PRH regime. Although the authors include experiments with frozen pretrained models, they are trained on natural data and evaluated on synthetic data outside of their training distribution. The observed limited alignment may therefore partly reflect this distribution shift.
- Considering physical systems is a good way of having a controlled way of testing the PRH, but it is a very limited representation of the world. The convergence predicted by the PRH may emerge because models see a world so complex, rich, and diverse that the way they are trained constrains them to converge toward only one shared representation. Since the physical systems considered here cover a restricted part of that world, the training may leave greater freedom in how models represent it, potentially explaining the limited alignment when .
Questions for authors
- Table 31 and Figure 9 show that alignment does not increase monotonically with . Could you explain this pattern and provide the alignment metrics more finely between and ?
- Can you clarify Figure 3? Is the ground truth represented before or after the swap? What are the visual differences between the pairs of images?