- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper explores how self-recognition signals can persist without self-preference in behavioural analysis. Previous literature in this domain often attributed self-recognition to self-preference. Alternative explanations for self-preference included familiarity and quality.
In their method, the paper controls for 'shared-belief' by fixing a wrong answer from both the judge and the evaluatee. They find that, in this setting, self-preference exists only in some tasks. To test for recognition, they use a linear probe.
To assess surface features, the paper rewrites the judge’s own responses to remove four kinds of signal: style, characteristic vocabulary, reasoning structure, and alignment-style phrasing like hedges and disclaimers. They test all 16 combinations and attribute B₀ with exact Shapley values. On MMLU, vocabulary contributes most and style almost nothing. The part that survives all four rewrites (ρ) is the largest component for every judge with a positive residual.
Critical strengths
The work decomposes self-preference signals using Shapley values. This enables us to study different surface cues and their impact on self-preference. This method is neat, as it handles the overlapping impact of signals in a principled way. The unexplained part is measured, allowing the work to test the surface feature hypothesis.
Critical weaknesses
The matched 'proxy' is used based on the incorrect answer to the same question. The paper argues that this eliminates agreement on conclusions or answer quality. However, an open-ended response that yields the same incorrect answer may reflect different philosophies or reasoning, and that reasoning may also reflect quality.
The technical rigour of the probe design is underspecified. It is not convincing that the probe measures some confound in the data. Recognition may be a function of data attributes that the internal layer captures.
The paper focuses heavily on equations and tables, which makes the main takeaway harder to grasp. One recommendation is to focus on the intuition behind the perturbations and on plots of the residual decomposition for clarity.
Questions for authors
Please see the critical weaknesses section.
Response to Reviewer fnTj
We thank the reviewer for the detailed and constructive review. Your positive view of the Shapley decomposition is very encouraging, and all three points have helped us improve the paper.
W1. The same incorrect answer may still reflect different reasoning.
Thank you for pointing this out. We agree. Fixing the same incorrect answer removes agreement at the level of the conclusion, but the two responses can still reason differently. To exclude the influence of reasoning as far as possible, we ran a new crossed experiment for Qwen2.5-32B on MMLU. The judge's argument and the proxy's argument are each written once by the judge J and once by the proxy K, so that reasoning and writing vary separately.
Main effects (95% CI half-width): writer +0.196 ± .045, argument +0.037 ± .031.
As you expected, reasoning does contribute. Changing the argument shifts the preference by +0.037. With the reasoning held fixed, however, changing the writer shifts it by +0.196. This suggests that the residual may depend more on how the response itself is written than on its reasoning.
W2. Probe design and confounds.
Thank you for raising this. We agree that the original description of the probe was too brief, and we have added the full setup to the appendix for reproducibility. In short, for each judge we take the residual-stream representation at the last token of the response and train an L2-regularized logistic-regression probe to separate the judge's own response o_J from the matched proxy response o_K to the same question, with 5-fold cross-validation grouped by question.
This design already includes several controls. Since o_J and o_K reach the same incorrect answer, the probe can hardly rely on the content of the answer. Since the folds are grouped by question, no question appears in both training and test, so the probe can hardly rely on question features. With shuffled labels the AUROC falls between 0.46 and 0.56, close to chance. After style and lexical signals are removed, the AUROC drops by at most 0.020 for Qwen2.5-32B and Llama-3.3-70B, and to 0.862 for Qwen2.5-72B, still clearly above chance.
Inspired by your comment, we also ran a stricter check. We train a logistic regression on surface features alone (length, line count, markdown use, last token, answer-line format) to separate o_J from o_K, and then regress these features out of the activations and retrain the probe.
These attributes do carry some information, but they reach only about 0.7, and removing them barely changes the probe.
We also agree with your caution about the word recognition. The probe shows that authorship information is linearly decodable from the hidden states. This is recognition at the level of representations, and it does not show that the judge uses this information when it votes. We now state this definition in the method section and have tightened the wording in the abstract, the introduction, and the experiments accordingly. Thank you for pointing it out.
Finally, we believe this issue does not change the main conclusion. Whatever signal the probe captures, it is present both where preference appears and where it does not. For Qwen2.5-7B on MMLU, for example, the AUROC is 0.975 while B₀ is −0.041. A signal that is present in both cases can hardly explain why preference appears in only one of them. The dissociation therefore does not depend on which information the probe reads.
W3. Presentation.
Your suggestion is well taken. We have added an intuitive description of each rewrite to the Remark in the method section. The style rewrite retells the same content in another writer's voice, the lexical rewrite swaps a model's favorite words for neutral synonyms, the reasoning rewrite keeps the facts and conclusion but changes the order of the argument, and the alignment rewrite strips assistant-style packaging such as hedges and disclaimers. We have also added a figure of the residual decomposition that shows its main conclusions at a glance, and reformatted the main tables to make them easier to read.
Thank you again for the valuable feedback.