- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates whether including a text in training increases its likelihood relative to excluded texts. Using randomized inclusion experiments, the authors show that replacing the original tokens with teacher-provided targets on fixed prefixes can reverse the likelihood-gain contrast between included and excluded trajectories. They also report preliminary on-policy distillation experiments. The paper argues that this reversal can undermine auditing scores that assume training members receive larger likelihood gains.
Critical strengths
None.
Critical weaknesses
1.The connection to practical data auditing is insufficiently established.
In on-policy distillation, the response trajectories are generated by the student itself, whereas an external data owner would typically want to audit whether their prompts or documents were used. The paper does not sufficiently explain how auditing these student-generated trajectories addresses that practical concern, particularly when the data owner cannot access the trajectories generated during training. Although the fixed-prefix experiments establish a controlled counterexample, the practical relevance of this setting needs clearer justification.
2.The additional insight and practical contribution appear limited.
When the supervision target is replaced by teacher labels, increasing the likelihood of the original tokens is no longer the training objective. Consequently, the possibility of a weaker or negative likelihood trace is intuitive. The paper empirically establishes an aggregate reversal, but provides limited predictive understanding of when it occurs and limited evidence of its consequences for auditing methods that calibrate the score direction. Without a stronger demonstration of these consequences or a substantive methodological advance, I find the contribution insufficient for acceptance.
Questions for authors
1.What concrete auditing scenario allows an external data owner to obtain and audit the student-generated trajectories studied in the on-policy experiments? How do the findings translate to auditing externally supplied prompts or documents?
2.Beyond a fixed-direction likelihood score, which auditing methods remain substantially impaired after independent calibration of the score direction?