- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper examines how the geopolitical information captured in country representations and authentic language speech representations -- extracted from attention-heads, using linear probes. The paper also demonstrates whether that can be transferred cross models, and whether that can be intervened.
The paper, using data from UN voting records, shows high correlation between country representations and their geopolitical positions, but less correlations when using speech representations. The paper also shows that it's possible to intervened the model generation output. Also, the linear probes can be transferred cross models.
Critical strengths
This is an interesting paper showing how LLMs capture geopolitical informations in their attention-heads. The paper wisely makes use of existing works for its purposes, showing evidence for the claims.
Critical weaknesses
The paper uses correlations to show whether the information of interested is captured, based on linear probes. Although this is quite standard in this line of research, it can be misleading.
- First, linear probes can be very expressive (or not) depending a lot on the nature of the data. Here, the authentic speech has quite much lower correlation coefficient might be because its corresponding attention-head representations are less easy to exploited by the linear probes, compared to country name.
- Second, using correlation coefficient \rho alone is pretty less informative. For instance, how could we say 0.8 is good (or bad). Therefore, a baseline could be helpful (e.g. using some vague information, such as location of the country of interest -- e.g. replace "China" with "Asia country").
It's unclear about the significance, importance of the contributions of the papers. It seems that the paper's technicality builds upon existing work in the literature. In terms of findings, how exactly the community can benefit from the findings?
Questions for authors
Are lambdas in equation 3 and 5 the same?
2 comments
Part 2/2: Using Voting Records to Study Diplomatic Language and Compare Models
You asked what other researchers can gain from these findings. One practical use is to test whether a political coordinate learned from country identities responds to what a speaker actually advocates. A second is to use scores from one model to establish and independently evaluate a country readout in another.
1. Evidence in the submitted paper — from country names to diplomatic language
In Section 4, we fitted readouts on country-name activations using voting-derived targets from the speeches' reference period. We applied them to 1,710 authentic UN speech passages from 186 countries after masking specified speaker-country names. Country scores obtained by averaging passage predictions tracked the voting-based ordering (ρ = 0.503 for Qwen, 0.449 for Llama, and 0.311 for Mistral). This gives researchers a way to ask whether an external behavioral measure carries over to a corpus without fitting the readout on that corpus. It also raises a testable question: would the score change if the same speaker advocated a different policy?
2. New rebuttal experiment — changing the policy while holding the speaker fixed
We wrote paired statements advocating concrete alternatives on 12 UN resolutions and kept the original speech readouts frozen. On nuclear disarmament, for example, one statement called for an open UN working group and the other favored keeping negotiations in existing intergovernmental channels. We attributed both statements to the US, then attributed the same two statements to China. For each resolution, observed votes and ideal points determined which policy was expected to score higher.
Averaged over the 12 resolutions, the policy contrast had the predicted sign in all three models under both fixed speakers. The mean differences for Qwen, Llama, and Mistral were +0.129, +0.135, and +0.127 with US attribution and +0.145, +0.202, and +0.135 with China attribution. Changing the advocated policy can move a name-trained readout even when the named speaker stays the same. Speaker attribution also affects the score. These controlled statements establish sensitivity to policy content, while the relative contributions of content and indirect identity cues in authentic speeches remain unmeasured.
3. Evidence in the submitted paper — reusing the measure across models
In Table 3, a source readout fitted on 96 countries supplied predicted scores for 57 different countries. Those scores served as the only training targets for a readout fitted on the second model's own activations. On 38 countries held out from both fits, the target readouts tracked the voting-based ordering at ρ = 0.649 for Qwen → Mistral, 0.651 for Mistral → Llama, and 0.699 for Llama → Qwen. Each correlation exceeded all 100 controls that shuffled the source scores across the 57 countries before refitting the target readout.
A researcher comparing models can therefore reuse the source model's country scores as supervision and check the resulting measure against independent voting labels on held-out countries. We will foreground these uses in the discussion and distinguish the evidence for policy sensitivity from the evidence for cross-model transfer of country rankings.
Part 1/2: What Geography Explains and What the Speech Readout Measures
Thank you for the care you put into reviewing our paper and for suggesting a geographic baseline. In response, we added a geography-only predictor and checked whether the readouts distinguish countries within the same region. Your suggested baseline is informative: fine geographic groups alone yield ρ = 0.666. Even within Asia, however, the three models track differences in voting alignment among the 47 countries (ρ = 0.652–0.679).
1. New rebuttal analysis — a geographic baseline for interpreting ρ
We gave the baseline each country's actual UN M49 geographic group. For each held-out country, it predicted the mean voting ideal point of training countries in that group. We compared it with the original 64-head country-name readouts on the same 190 geographically matched countries, using the original five folds.
The within-Asia comparison follows directly from your example of “an Asian country.” We also checked the result across the full cohort by subtracting each finer group's mean rank from both the predicted and observed ranks. The resulting correlations are 0.637 for Qwen, 0.599 for Llama, and 0.597 for Mistral. Thus geography explains some of the ordering, and the readouts recover additional differences among countries that share a geographic label.
2. Evidence in the submitted paper — the role of the probe on authentic speech
We agree that relevant information in speech may be harder to extract linearly. Section 4 fits and tunes the probe on country-name activations, then evaluates country rankings obtained from masked speeches. The lower speech correlation tells us how well this readout transfers. The size of the gap alone cannot tell us how much political information each representation contains.
Submitted Table 9 directly compares two linear readouts on the same speeches from the same 186 countries. Both exclude held-out countries from head selection and fitting. The only change in this comparison is whether we use the top head or average predictions from the top 64.
This supports your point about accessibility. On identical speech inputs, the choice of readout makes a substantial difference for Qwen and Llama. The increase is less certain for Mistral. Submitted Table 7 tests a different question on country names: replacing ridge with a shallow MLP at the same linearly selected heads changes ρ by +0.005, −0.005, and −0.023, respectively. Whether a nonlinear decoder could recover more from authentic speech remains open.
3. Clarification of Equations (3) and (5)
The two λ values are set separately. Equation (3) fits a predictive readout on standardized features with an unpenalized intercept. The main country-name ensemble uses λ = 100, and the single-head speech analysis selects λ by inner cross-validation on training countries. Equation (5) constructs the steering direction from raw country-name activations with λ = 1 and no intercept. The intervention strength is α. We will distinguish the penalties in the notation and add the geographic baseline alongside the country-name results.