- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper empirically tests the Platonic Representation Hypothesis (PRH) and its Aristotelian refinement (ARH) for representational convergence in foundation models, using multi astronomical observations as physical reference frame. The work systematically analyzes how model capacity, training regimes, and architectural types shape patterns of representational convergence. The study covers 11 foundation model families spanning major training paradigms, supervised classification, self-supervised knowledge distillation, masked autoencoding, vision-language pre-training, and astronomy-specific domain data, with parameter scales ranging from 10M to 10B. The authors use linear probing to test models’ ability to encode three core astrophysical parameters: redshift, stellar mass, and specific star formation rate. They further quantify similarity across representation spaces using two metrics: Mutual k-Nearest Neighbor (MKNN), which captures local neighborhood alignment, and Centered Kernel Alignment (CKA), which measures global geometric alignment. Key findings include: (1) Larger models encode more physics knowledge; (2) Physics performance is correlated between modalities; (3) only local representational alignment strongly correlates with physics performance, and this pattern holds even for cross-modal scenarios such as DESI spectra vs. HSC images. The results suggest that astro-foundation models can build on general-purpose pre-trained models, leveraging the substantial computational investment already made in the broader machine learning community.
Critical strengths
-
By leveraging observations of the same galaxies from multiple astronomical instruments and using physical parameters independent of the training distribution as the benchmark, this work addresses a limitation of prior PRH/ARH studies: their reliance on circular validation confined to the natural image domain and the corresponding lack of an independent ground-truth reference. This design improves the objectivity of the conclusions. However, the novelty of this work remains ambiguous due to the absence of a dedicated related work section.
-
The study covers mainstream training paradigms and architectural families of foundation models, and controls for confounding variables across model families via ANCOVA.
Critical weaknesses
-
Lacks a dedicated Related Work section, leaving the academic contribution poorly contextualized. The paper only mentions related studies sporadically in the introduction, and does not systematically synthesize the research landscape of representational alignment metrics, representational convergence, and foundation models in astronomy. Readers cannot clearly delineate how this work advances beyond the original PRH study, the ARH refinement, and prior work on astronomy models, making it difficult to accurately identify its specific innovations and scholarly value.
-
Research is primarily descriptive, with limited mechanistic explanation and practical guidance. The core conclusions of the paper remain at the level of phenomenological statistics, without in-depth investigation of the underlying mechanisms. For example, it does not explain why convergence manifests only in local neighborhood structure rather than global embedding geometry (Sec. 3.2), why distillation training causes models to deviate from the general convergence trajectory, or why the language backbone impairs encoding of physical representations from visual inputs (L316-323). Furthermore, the study does not derive actionable recommendations for architectural optimization or training strategy adjustments based on its findings, limiting both the academic impact and applied value of the work.
-
The authors have modified the in-text citation style, which deviates from the official specifications defined in the ICLR 2027 submission template.
Questions for authors
- Does the scaling relationship between model capacity and physics encoding ability still hold under random initialization? Sec. 3.1 concludes that larger models encode more physics knowledge, and that this effect is independent of pre-training data type (natural images, vision-language data, or astronomical data). It is recommended to supplement linear probing experiments with randomly initialized, frozen backbones, using the DINO-v3 ViT architectures from small version to 7B parameters, to verify whether the “larger models encode more physics” phenomenon persists without pre-training.