Could LLM Watermark Detection be Public?
Abstract
Watermarking large language models is popular for tracing their outputs, yet detectors remain unreleased since exposing them could allow attackers to steer their edits with the detector's feedback. However, watermarks are already vulnerable to uninformed tampering attacks. We thus first quantify whether a public detector would be an additional liability in a deployment setting at varying levels of access, from token-level scores to a binary verdict. Second, we introduce a split-key public-private watermarking method that exposes one key through a public detector while keeping the other for full verification and forensics. An informed attacker can only move the public signal, which creates an imbalance between public and private scores. We introduce a statistical test for this imbalance, and combine it with the full key verdict in a two-stage mechanism. Third, we evaluate the split-key method on a wide range of removal and forgery attacks, comparing both uninformed and detector-informed settings. We show that public detection improves removal only at small edit budgets, since plain rephrasing already strips the watermark at a lower quality cost, but it does enable forgery, which the private pipeline can identify. Overall, releasing half of the watermark enables transparency and interoperability, while tampering with the released half is detectable, bounding its liability and questioning the need for keeping detectors fully private.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.