- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper mainly studies the reliability of black-box LLM watermark detection. The paper tested exsiting watermark detection methods and found: 1) false negatives: even if the model is watermarked, prompt-aware repeated-context masking can cause detection methods to failed; 2) false positives: even if the model is not watermarked, certain natural language patterns may be mistakenly identified as a watermark signal. They evaluate several probe designs using controlled experiments on Qwen and API-based experiments on Claude. Finally, the paper detected strong statistical signals in Claude (reportedly watermarked), but could still not confirm that the signal originated from the watermark.
Critical strengths
- The paper examines watermark detection in real-world black-box deployment settings, where watermark parameters and implementation details are unknown. This is a meaningful setting.
- The paper explores multiple probe designs. The discussion of inconclusive results is transparent.
Critical weaknesses
- The main findings appear to be largely predictable from the known mechanisms and assumptions of watermark generation and detection. While the empirical validation is useful, the paper does not clearly establish what fundamentally new insights it contributes beyond confirming these anticipated failure modes.
- Although the paper identifies limitations of existing detection methods, it does not establish a reliable alternative. The final probe lacks successful validation on a prompt-aware watermarked reference model, while the deployment results are affected by substantial context-dependent refusals, sensitivity to statistical estimators, and inconclusive replication. Consequently, the central empirical findings remain difficult to attribute specifically to watermarking, substantially limiting the paper's contribution.
Questions for authors
- What is the key technical novelty beyond identifying known failure modes of watermark detection? Prompt-aware masking is a useful counterexample, but what previously unknown mechanisms or principles does it actually reveal?
- Can the authors validate the final detection protocol on a controlled prompt-aware watermarked model? If the final method cannot effectively detect watermarks even on controlled positive controls, how can the significant results observed in deployment be explained?
- How can the authors distinguish watermark-induced effects from native model behavior and selective refusals? The current comparisons do not support this attribution. The authors need more convincing controlled experiments or statistical methods.
1 comment
| Comment | Response | Lines |
|---|---|---|
| W1 / Q1: findings predictable from known mechanisms; what is fundamentally new? | Acknowledged in part: some failure modes follow from the test's stated assumptions. New and not derivable from the published analysis: (1) a prompt-seeded history switches marking off at the probed position while the watermark stays active elsewhere, so an echo null cannot exclude a watermark; (2) two probes that pass every reference control fail on the deployed family; (3) a power floor set by key count, not sample size; (4) native column structure on an unwatermarked reference under the final probe (Section 3.3); (5) the probe's pattern growing on a sibling once the provider marks it (Section 4.4). | 58–75; 260–269; 424–446 |
| W2 / Q2: no validation on a prompt-aware reference; if the method fails on controlled positives, how are deployment results explained? | Validation: yes. On a reference that copies forty digits reliably the final probe detects the prompt-aware watermark as it detects the stock one (Section 3.3). Caveat stated there: the unwatermarked reference also shows column structure, so effect size, not the p-value alone, separates the cases. Deployment results: explained against three accounts with evidence for and against each (Section 4.5); the refusal-free re-check favours the keyed-watermark account, while the pre-registered Fable decision stays inconclusive because its refusal condition failed. A reliable alternative detector is outside the paper's aim. | 249–269; 448–475 |
| Q3: how to distinguish watermark effects from native behaviour and selective refusals? | By a same-model contrast, which the provider's marking supplied. Size alone does not decide: an unwatermarked reference can produce a shift of Fable's size under this probe. But on an unchanged identifier and with zero refusals, Sonnet 5's shift grew fourfold (range 0.12 to 0.47) and tightened onto Fable's column pattern (r=+0.53 to +0.86), which a fixed native preference does not predict and the refusal filter cannot produce. Stated limits: a faint pattern of the same direction preceded the marking, marked Haiku 4.5 shows no such shift, and only the provider's detector can confirm a mark. | 260–269; 431–446; 452–475 |