- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies how knowledge distillation affects LLM authorship attribution. The authors show that, after a student model learns from a teacher, existing attribution classifiers become much more likely to incorrectly identify the student's outputs as coming from the teacher. Retraining these classifiers on outputs from the distilled student recovers most of the lost accuracy. The paper also presents an information-theoretic analysis to explain why distillation makes the outputs of the two models harder to distinguish.
Critical strengths
Authorship attribution is a meaningful problem, and the experiments cover multiple models, attribution methods, and distillation settings.
Critical weaknesses
- The experimental results are unsurprising and the theoretical contribution is weak. The proposed "intrinsic source information" is essentially the Jensen–Shannon divergence between teacher and student output distributions. Since distillation minimizes their KL divergence, the local decrease in JS divergence is unsurprising. This also does not yield that the models are becoming indistinguishable.
- Poor performance from classifiers trained before distillation mainly demonstrates distribution shift, not intrinsic indistinguishability. The authors' own retraining experiments recover much of the lost accuracy. The remaining gap may simply reflect classifier limitations rather than a fundamental difficulty in distinguishing the models.
- More fundamentally, the output distributions of two models becoming more similar does not make them indistinguishable. As long as their output distributions are not identical, they remain statistically distinguishable in principle, given sufficiently many independent observations.
Questions for authors
None