- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how frozen language models establish form–meaning associations for novel words through contextual usages and whether such associations can be reused. The authors employ reciprocal meaning assignments, activation transplantation, and held-out semantic judgments to examine whether semantic information transfers to new tasks without the original usage contexts. Experiments on Qwen and Gemma further investigate the effects of form–meaning consistency and subsequent evidence. The authors characterize the resulting history-dependent, transferable, and evidence-sensitive relation as a revisable lexical hypothesis.
Critical strengths
The experimental design is reasonably rigorous. Rather than relying solely on behavioral evidence of novel-word learning, the authors use interventions on pre-query activations to investigate whether semantic information is available before the query. In particular, the changed-form versus unchanged-form comparison and the donor versus random source control help distinguish general activation transfer from form-related semantic influence.
Critical weaknesses
My main concern is the remaining gap between the definition of lexical function and the experimental evidence. The authors transplant residual states from previous usages and show that these states can influence subsequent semantic judgments. However, the transplanted activations contain rich contextual information rather than an isolated form–meaning binding representation. Therefore, the results demonstrate that semantic information derived from previous contexts can be reused, but they do not clearly establish a lexical representation distinct from general contextual information integration. In particular, the experiments do not directly disentangle the transfer of semantic content from the transfer of the form–meaning relation itself. Both mechanisms could potentially produce similar output changes. I acknowledge that the authors define a lexical hypothesis functionally rather than as a localized dictionary entry. Nevertheless, even under this operational definition, stronger evidence is needed to establish selective access through the associated form.
Questions for authors
see above