- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how language-model scaling changes the representation structure associated with externally annotated skills. The authors introduce a task- and template-conditioned RSS measure with random-label calibration and decompose it into between-skill separation and covariance components. Experiments across Pythia and Qwen2.5 suggest that larger models generally exhibit stronger separation between skill-conditioned representation centers and larger held-out prototype margins. The paper further examines the functional relevance of the identified subspaces through representation interventions and applies the resulting diagnostics to adaptation-data selection under limited training budgets.
Critical strengths
S1: Meaningful Research Problem. The paper studies how model scaling changes internal representation structure, which is a meaningful question for understanding capability formation in large language models.
S2: Preliminary Practical Potential. The representation-guided data-selection experiment provides a useful proof of concept that a simple skill-diagnosis signal can inform model adaptation under a limited training budget, connecting representation analysis with practical training decisions.
Critical weaknesses
W1: Limited Generalizability of the Skill Interpretation. The central analysis depends on a fixed skill taxonomy generated by an external language model. The reported trend may therefore reflect separability under this particular label system rather than a general property of language-model representations. Without validation across independently defined skills, broader domains, or model-derived capability structures, the finding remains narrow and not fully convincing.
W2: Limited Link to Scaling-Related Behavioral Change. The decomposition, held-out, and intervention results show that the identified geometry is non-random and functionally relevant. However, the paper does not show whether its strengthening predicts task performance, generalization, or error patterns. The adaptation evidence is narrow, covering two models and showing only a small gain for Qwen2.5.
Questions for authors
Q1: The study covers models up to 32B parameters. What evidence suggests that the reported trend extends to substantially larger models rather than saturating or changing beyond the evaluated range?
Q2: Does the proposed skill geometry predict performance gains, error patterns, or transfer across templates and model scales beyond what can already be explained by model size?