- Rating
- 4
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper creates a benchmark (Olmo-Detect) for membership inference, detecting whether a document has been included in the training data of an LLM. The data and benchmark is based on the Olmo 2 model, for which the training corpus and different trained model sizes are available. The authors have put quite a lot of thought into the corpus creation, in order to eliminate possible confounding factors. A number of detection methods are also evaluated on the resulting corpus.
Critical strengths
The work is strong, the corpus seems like a useful contribution to the field. A lot of thought and careful data engineering has been put into selecting the members and non-members in the dataset. Both are aligned as best as possible on text quality, temporal range, and lexical similarity. Non-members are filtered against the full training corpus with a 13-gram filter. This is the first membership inference benchmark to cover mid-training. The study covers 18 methods and 4 model sizes.
Critical weaknesses
There may be some data leakage in the math domain, as GSM8K is used both for mid-training and post-training. The latter uses CoT-GSM8K but these are essentially the same training questions. The RLVR post-training doesn't directly train the model to reproduce the GSM8K data, but the mid-training does. So the current RLVR domain evaluation seems more likely to be detecting whether the datapoint was used in mid-training as opposed to post-training.
The paper is currently very densely written. The related work section is essentially just a list of references. The results section spends quite a lot of space just repeating selected numerical results from the tables. This is not really necessary, as the results are already presented. This space would be better used by highlighting the most important findings and analysing them in more detail. Overall, I would recommend editing the paper to make it a bit nicer to read. If necessary, some less important details can be moved to the appendix.
Update after author response:
Thank you for addressing these concerns. As it is not possible to increase the score further, I will leave it as is.
Questions for authors
None
3 comments
Replying to author response
Thank you for addressing these concerns. As it is not possible to increase the score further, I will leave it as is.
Dear Reviewer qwM2,
Thank you for your reply and support of our work.
Best regards,
The Authors
Response to Reviewer qwM2
We thank the reviewer for the positive and insightful review. We address each weakness below.
Weakness 1: overlap of GSM8K questions between mid-training and post-training
We agree with this concern. It is the consequence of OLMo 2's documented reuse of GSM8K across stages: RLVR uses all 7,473 GSM8K training questions, and all of them are also in the mid-training data. This issue cannot be avoided by a different construction.
Revision. We have added a Limitations section (Section 6), which states this training data reuse as an inherent limitation.
Weakness 2: dense writing
We agree that the paper is currently densely written and that its related work and results sections can be improved. We have revised both accordingly, with the changes highlighted in the revised PDF:
We hope the responses above address your concerns. Please feel free to ask any further questions; we would be happy to respond.