- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a method that optimizes content protection text through LLM-based evolutionary search so that content owners can prevent unwanted LLM use. A single model plays two roles by generating the protection text and answering questions over the document with that text attached. Using the answer suppression rate as the signal, the method iteratively refines the text for that model.
Critical strengths
- The paper addresses a timely problem, and such content protection techniques will become increasingly necessary. The method is designed to find effective protection text with evolutionary search, without any training.
Critical weaknesses
- There is no evidence for the contribution of PACT's evolutionary search. For example, there is no baseline that samples candidates from the initial procedure (with a matched budget to PACT's) and picks the best one.
- The other two optimization baselines (Web-IP, WebCloak) are not meaningfully better than the static text methods (AI.txt, Robots.txt), and there is no explanation.
Questions for authors
- Could you share the performance of a baseline that samples all the candidates from the initial procedure (with a budget matched to PACT's) and picks the best one?
- Why do the other protection-text optimization baselines (Web-IP and WebCloak) perform so much worse?
2 comments
Dear Reviewer,
We sincerely appreciate your time and effort in providing such thoughtful reviews and insightful comments.
Could you please kindly let us know if our rebuttal has addressed your concerns?
If you have any further questions regarding our work, we would be delighted to address them.
If our responses have addressed your concerns, we would greatly appreciate your reconsideration of your overall assessment.
Best regards,
Authors
Dear Reviewer,
Thank you again for your valuable comments. As the discussion period is nearing its end, we would like to kindly ask whether our responses have adequately addressed your concerns. Please let us know if any further clarification is needed. If our responses have resolved your concerns, we would sincerely appreciate your consideration in updating your evaluations accordingly.