- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Coupled Usage–Sense Processes (CUSP) for measuring and interpreting lexical semantic change. The authors fit Gaussian mixture models to contextual embeddings in each time period, match usage components across adjacent periods with hierarchical optimal transport, and chain these matches into a single multi-period process through Markov composition. On top of this process, they split the overall change into movement of component centers and variation within components, and attribute it to specific component pairs and distinct temporal directions. The paper gives formal proofs and reports experiments on synthetic data, DWUG, Janus, and a corpus of U.S. court opinions.
Critical strengths
-
Intuitive and unified design. Representing a word's usages as latent components and using optimal transport to describe how their distribution shifts across periods is a natural and interpretable approach. The amount of change, its timing, and its attribution to components all come from one probabilistic process, which makes the framework mathematically coherent.
-
A clean decomposition of change. Through conditional centering, the total squared displacement splits exactly into a part from moving component centers and a part from variation within components, and both parts can be assigned to specific component pairs. This makes the change score far more informative than a single number.
-
Experiments at several levels. Synthetic data tests statistical recovery, DWUG tests whether the overall change score is plausible, Janus tests controlled temporal shifts, and the court corpus shows how the statistical output can be linked to real historical text.
Critical weaknesses
-
The linguistic meaning of mass matching under balanced optimal transport needs more explanation.
CUSP uses balanced optimal transport to match components across time periods. Consider the word plane, which can mean a geometric plane or an airplane. Suppose the shares of these two senses change from 90%/10% to 30%/70%. If these are the only two components, balanced optimal transport must move at least 60% of the probability mass from the geometric sense to the airplane sense. Yet both senses may have existed side by side throughout this period. The larger share of the airplane sense may simply reflect an increase in aviation-related texts.
This mass flow could have different meanings. It might describe a statistical shift in the usage distribution, or it might represent a possible path of semantic change. The authors should clarify how they interpret this flow and how that interpretation supports their claims about historical semantic change.
-
Component-level explanations need more direct evaluation.
One of the paper's main goals is to explain which usages change, when they change, and which components contribute most. However, the current experiments mainly test overall change scores and the recovery of temporal change patterns. DWUG evaluates the correlation between the model's scores and human judgments of change. Janus tests whether the model recovers predefined change patterns over time. The court examples show the model's attributions through passages from real texts.
These experiments provide useful evidence, but one important question remains: Do the main components and their links across periods match actual differences in usage and semantic change? For example, the passages in the court cases show different usages, but it would help to test whether the main component movements reliably capture those differences.
Existing data could support a more direct test. Janus includes known sense labels. The authors could compare the fitted components with these labels and check whether the main component movements reflect the predefined changes in sense proportions. DWUG also provides sense clusters built from human judgments of semantic similarity. These clusters could help test whether the model's attributions agree with human judgments. This evaluation could allow several model components to correspond to the same sense.
The authors could also refit the model on different subsets of the court corpus to check whether the main change periods and key component attributions remain stable. These tests would provide more direct evidence for the paper's claims about component-level explanations.
-
The presentation and organization are unclear.
The abstract uses many technical terms, such as "hierarchical coupling," "displacement operator," and "word-local modes," with little intuitive explanation. This makes it hard to understand the research question and main idea quickly.
The mathematical properties introduced in the introduction also need more explanation. Temporal consistency mainly follows from composing Markov transitions, while preservation of the marginal distributions follows directly from the constraints of optimal transport. The authors present these properties as major contributions, but do not explain clearly why they matter in practice. The introduction would be clearer if it first explained the reasons for these modeling choices and then presented their properties.
Finally, the paper has no separate Related Work section. Previous studies are covered in one dense paragraph in the introduction, which reads like a list of references. Table 3 in the appendix compares the capabilities of different methods, but the main text does not clearly explain how CUSP relates to or differs from prior work in terms of research questions and methods.
Questions for authors
-
Why did the authors choose balanced optimal transport instead of unbalanced optimal transport, which allows probability mass to increase or decrease? Under this modeling choice, how should we interpret the flow of probability mass between components across time from a linguistic perspective, especially when new senses appear, old senses decline, or existing senses coexist while their usage proportions change?
-
Could the authors use existing sense clusters based on human judgments in datasets such as DWUG to test more directly whether CUSP's main components and their cross-period links match human evidence? If the model is refitted on different subsets of a corpus, such as court opinions, do the main change periods and key semantic drivers remain stable?
-
Could the authors make a clearer distinction in the introduction and discussion of prior work between modeling choices, properties guaranteed by the model's construction, and results established by theory? Concrete examples of why these properties matter for studying lexical semantic change would also be helpful.
Thank you for the detailed responses and additional experiments. The controlled experiments and the DWUG cluster analysis largely address my concerns. I have update my score accordingly.