- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The work studies black-box auditing for the presence of LLM watermarks by comparing model responses under different restrictions on the allowed tokens (i.e., varying the top-k parameter). The underlying idea is that watermarking schemes respond differently to changes in top-k. Based on this, the authors propose two methods: (1) Water Zero, an exact conditional test for SynthID, and (2) Water Sonar, which can detect a wider range of watermarks but builds on a learned regressor that assumes prior training. In particular, Water Sonar uses several features (like token counts, diversity, and entropy) and fits a logistic regression model for watermark identification. Its score for a target is then compared against clean audits to estimate statistical significance. The authors evaluate their methods on Qwen and Llama models using C4 and OpenGen, showing that Water Zero can detect SynthID while Water Sonar is able to (reasonably well) detect a range of watermarks at a 5% FPR level.
Critical strengths
Detecting black-box watermarks has (with the recent EU AI Act implementation) become a quite relevant topic of study.
Critical weaknesses
-
The method relies on being able to control top k, which is a strong assumption for a black box audit. It is unclear which model providers offer the required access. If the restriction is instead requested through a prompt, this could itself influence the output probabilities. The method also depends on the order in which watermarking and top k filtering are applied. These assumptions substantially limit the practical setting in which the results apply.
-
Given these access requirements, the empirical results seem limited. Water Zero appears to work only on SynthID, and its advantage over prior work by Gloaguen et al. is unclear to me. Water Sonar shows limited results for several schemes, including KGW, EXP and ITS, with stronger results limited to SynthID, AAR, DiPmark and -reweighting. This seems a modest outcome given that controlling top k is a much stronger assumption than using handwritten prompt templates. Lastly, the evaluation should also include data for instruction tuned models beyond C4 and OpenGen, as this is how models of interest will be served in practice (and which can have significant impact on a watermark).
-
Prior work also often aimed to extend their studies to estimate particular hyperparameters of the watermark (e.g., context size). This quite relevant aspect of black box identification seems to be missing here.
Smaller Comments
The writing is difficult to follow in places, with frequent semicolons and uncommon terms such as “menu”, “development data” and “arms” that are not clearly introduced. The citation format also seems strange (no citep used it seems), and reference for the appendix use "Section A" rather than "Appendix A". In line 228, it is unclear where the earlier paired Water Zero rule was introduced.
Questions for authors
- Which model providers expose the top k controls required by your audit, and how do you establish whether watermarking is applied before or after top k filtering? Further can your method be used for estimating parameters of the actual watermark or only the watermark family itself?
- Why do you think you do not perform well on several watermarking families (e.g. KGW), could you give some more qualitative details here?
- Could you clarify the exact watermarking parameters and prompts used in the main paper results?