- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper provides a log-likelihood-based method for detecting the association between paper titles and content, which can be used to detect whether an LLM has seen the corresponding data during training. This study is not about membership inference, nor does it aim to design source attribution. Finally, in the experimental section, this paper honestly reports both positive and negative results.
Critical strengths
Through empirical study, this paper honestly reports both positive and negative experimental results.
Critical weaknesses
- There are too many traces of AI editing; I strongly doubt human involvement in this paper.
- This method is similar to [1]; please refer to it and learn more about the LLM-based MIA background.
References:
[1] Detecting Pretraining Data from Large Language Models, ICLR 2024
Questions for authors
See Weakness.