- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper presents a model-agnostic view of language models as probability distributions over token sequences. It models natural language as a mixture of topic-specific distributions, called “dialects,” and interprets prompting as Bayesian reweighting of these components. It further proposes an account of fine-tuning and catastrophic forgetting based on changes in mixture weights and component distributions.
Critical strengths
The framework is intuitive, simple, and potentially helpful for reasoning about prompting and domain specialization. Its probabilistic formulation provides an accessible starting point for studying these behaviors.
Critical weaknesses
- The novelty is unclear, and the presentation obscures the contribution.
The framework appears closely related to existing Bayesian accounts of language-model prompting, particularly Xie et al.. Although this work is cited, the paper does not clearly establish what is inherited from prior work and what is substantively new. Consequently, the central observation feels interesting but insufficiently developed. The presentation compounds this problem. The introduction moves across several loosely connected topics, and the first five pages could be substantially more compact. A clear mathematical setup, with definitions and an explicit distinction between assumptions, probability identities, and new results, would make the contribution easier to assess. The literature discussion also needs broader coverage and more precise comparisons.
- The fine-tuning interpretation is insufficiently justified, and the experiments are underspecified.
The authors acknowledge that off-target dialect distributions can change during fine-tuning, but assume their approximate preservation in the proposed “healthy” regime. It is unclear why ordinary fine-tuning should predominantly change mixture weights while preserving the component distributions, and the experiments do not directly establish this behavior. For the natural-language experiments, the training dialects and their proportions are unknown. Assigning topic labels to generated outputs does not by itself demonstrate that those labels identify the assumed mixture components. The synthetic BERT experiment is also insufficiently specified: the training objective, optimizer, and the causal prediction procedure needed for the sequence-probability calculations are unclear. These gaps limit how strongly they support the proposed explanation.
Overall I feel like the novelty and contribution are limited given that the framework is not fully established.
Questions for authors
What substantive result distinguishes this framework from Xie et al.? In particular, why is a “dialect” more general than a latent concept that already indexes a distribution over sequential documents?
What justifies approximately preserving the component distributions during “healthy” fine-tuning? In the synthetic setting, can the authors directly demonstrate that early adaptation predominantly changes mixture weights rather than the distributions within dialects?
How do the Library of Congress labels assigned to generated outputs correspond to the unknown dialects in the training distribution What evidence supports interpreting these output-label frequencies as estimates of the proposed mixture weights?