- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether third-party comments on ordinary websites can serve as a practical entry point for poisoning language-model pretraining data. It introduces HALFLIFE, a framework that estimates the availability of injection opportunities and the survival of injected content through text extraction and data curation. Using Common Crawl pages and simulated replacement of existing comments, the paper reports approximately 3.9% post-injection survival and estimates that up to 3.5% of final web documents could be affected. It also examines alternative curation pipelines, programmatic advertisements, and synthetic rewriting. Finally, controlled pretraining experiments with 65M–1.3B models show that small prescribed poison-token fractions can shift entity preferences, with some effects remaining after clean supervised fine-tuning.
Critical strengths
-
The paper addresses a consequential gap between placing malicious content on the web and having that content survive into pretraining corpora. Studying ordinary comment interfaces and explicitly examining extraction and curation is useful because the effectiveness of poisoning cannot be inferred from content placement alone. This empirical focus is the paper’s strongest contribution.
-
The evaluation goes beyond a single filtering result: it includes alternative curation pipelines, a negative result for programmatic advertisements, and controlled model-training experiments. Together, these provide useful evidence that some injected natural-language content can survive tested pipelines and that such content can influence models when included at controlled rates. The use of simulated injections also allows investigation without deploying harmful comments on public websites.
Critical weaknesses
-
Some details of the injection experiment would benefit from clarification. The reported 3.9% survival rate concerns simulated replacement of comments in already-crawled HTML, so its interpretation as a practical injection success rate requires additional assumptions. Reporting the numbers of injected pages and comments, the diversity and reuse of poison texts, and the scope of comment replacement would make the estimate easier to assess. The sampling figures in Section 4.1 and Appendix F would also benefit from reconciliation.
-
The connection between the filtering results and the training poison rates could be made more explicit. Document-level deduplication can retain repeated comments within otherwise different pages, making the remaining repetition and any subsequent resampling relevant. The document-to-token conversion also depends on document lengths and the final training mixture. Since the natural-format comparison uses 0.1% poisoning, above the approximately 0.07% web-only estimate, results at lower rates would strengthen the practical interpretation.
Questions for authors
-
Could you provide the page/comment counts at each stage underlying the 3.9% estimate, clarify whether survival requires retention of the poison content, and explain the relationship between the samples in Section 4.1 and Appendix F?
-
Could you clarify how many distinct poison texts were used, how often they were reused, and whether all comments or only a subset were replaced? Was the three-comments-per-page assumption also used in the experiment?
-
Could you specify the deduplication configuration and corpus scope, the poison repetitions remaining afterward, and whether any resampling was used to reach the training rates?
-
How do the measured post-filtering poison-token fraction and the final data mixture relate to the chosen training rates? If available, results for Q/A and no-label formats below 0.1% would help assess this connection.
Thank you for the clarifications. I've increased my score. I acknowledge that some anti-spam mechanisms can be bypassed. However, it is unrealistic to me given the heterogeneity of real-world systems. It is not easy for an attacker to bypass various kinds of systems. Given this and the concern regarding the methodology novelty, I would keep a negative score.