- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a Constitution-Guided Watermarking framework: service providers write a watermark constitution in natural language, a verification agent searches for and iteratively refines watermark configurations for each rule, and at inference time a deployment monitor identifies which rules apply to a request and retrieves and executes the corresponding policy, while the service model remains frozen; each policy is recorded as a certificate documenting the configuration, measured evidence, and unmet criteria.
Critical strengths
The paper proposes a mechanism in which a verification agent reasons over natural-language constitution rules and adjusts watermark parameters. This is a distinctive contribution to configuration selection for text watermarking: it turns what properties the provider wants to prioritize from hyperparameter tuning into an auditable rule-based input, with the agent iteratively proposing configurations on an offline reference set.
Critical weaknesses
The paper aims to show that constitution guidance can improve robustness on a per-rule basis, but the absolute level of robustness is far below the thresholds the authors themselves set, and the relative improvement rests on a small-sample search of only 10 reference prompts per rule; moreover, the FPR is not an independent audit and cannot support the strong conclusion that "the policy is effective." Second, the evaluation scope and baselines are insufficient to isolate the contribution: a single watermark family, a single model, a single key, and a single seed, with comparisons only against fixed configurations and random search, and no Bayesian optimization, hand-crafted policies, or specialist-trained agents.
Questions for authors
This paper claim to address "constitution-guided watermark policy selection," yet the experiments use only a single base watermark method (KGW), and the verification agent searches only over KGW's parameters. This makes it difficult for me to judge whether the framework's conclusion is that "the constitution mechanism is effective" or merely that "KGW happens to find a relatively good point within this small configuration space." I suggest you instantiate the framework on at least multiple watermark families and have the agent make choices at the algorithm level, rather than only tuning KGW hyperparameters.