- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies black-box ownership verification for text-to-image models under downstream model and generation-pipeline modifications. Building on existing text-triggered semantic watermarking approaches, it constructs mappings between ordinary-word trigger phrases and deliberately unrelated target objects. It adds a negative loss term that encourages divergence from the original model on trigger data while preserving regular generation behavior. The resulting models are evaluated under a broad range of transformations, with reported improvements in watermark persistence over the evaluated baselines.
Critical strengths
Broad experimental coverage. The paper devotes substantial effort to evaluating 21 model-weight modifications, including fine-tuning, distillation, quantization, and pruning. Additional experiments cover different architectures and targets, prompt and output processing, and trigger-construction ablations. Reporting regular-generation quality alongside watermark detection is also useful. These experiments provide valuable empirical evidence under the tested transformations.
Critical weaknesses
W1. The trigger construction offers limited incremental contribution and leaves its security trade-off insufficiently assessed. Similar ingredients already exist in semantic watermarking: Watermarking Diffusion Model evaluates the ordinary-word trigger "chicken" [1], and WatermarkDM uses predefined photographic targets, not only QR codes [2]. Although the deliberately unrelated phrase–target pairing is a specific design choice here, its contribution appears to be a modest adaptation of existing components rather than a substantial methodological advance. Moreover, compared with rare identifiers or random strings, ordinary-word triggers may be more discoverable through active probing guided by natural-language priors. Avoiding input filtering therefore does not necessarily imply stronger trigger secrecy. The paper discusses the cost of exhaustive enumeration and the use of combinatorial phrases, but does not adequately assess this comparative discovery risk or the associated security trade-off.
W2. The connection between the negative term and persistence under specific modifications remains insufficiently explained. Encouraging trigger predictions to differ from the original model does not by itself establish why the resulting mapping should survive fine-tuning, transfer through distillation, or resist quantization. Appendix B.2 provides gradient-cosine observations, and B.3 provides residual-reconstruction evidence, but neither establishes how the negative term causes the relevant behavior. In particular, preserving an existing watermark during fine-tuning is different from transferring it to a clean student trained only on regular teacher signals. The reconstruction probe uses trigger residuals for fitting/selection, whereas the actual student does not access them. Appendix F offers a useful conditional result for a fixed-feature model under bounded common perturbations, but it does not isolate reduced modification sensitivity from improved initial fitting margins or explain the actual distillation and quantization processes. Controlled comparisons with matched initial continuous trigger error and regular utility would help establish the source of the persistence advantage.
W3. The attack-coverage claim is too strong, particularly given the missing subject-level adaptive evaluation. The statement "we consider the comprehensive set of transformations adversaries may use" overstates the scope of the evaluation, which does not establish coverage of the broader space of adaptive evasion strategies. Although Appendix C evaluates global prompt–image consistency filtering, the proposed watermark changes the depicted subject, while agreement with the background and other prompt details may obscure that mismatch in a global assessment. A subject-level consistency filter would therefore be more directly targeted at this design and could constitute a stronger adaptive attack. The paper neither discusses nor evaluates this specific strategy. Its effectiveness remains to be tested, and the robustness claims should be restricted to the evaluated transformations.
[1] Liu et al. Watermarking Diffusion Model.
[2] Zhao et al. A Recipe for Watermarking Diffusion Models.
Questions for authors
- Regarding W1: What substantial contribution does the trigger construction provide beyond existing ordinary-word triggers and predefined image targets? Compared with rare identifiers or random strings, how does it affect trigger discoverability under active probing?
- Regarding W2: Please explain the rationale for the specific negative term in greater detail. How do the mechanisms of fine-tuning, distillation, and quantization motivate encouraging trigger behavior to diverge from the original model? What analysis or targeted evidence links this design to watermark persistence after modification, beyond showing that adding the term improves empirical performance?
- Regarding W3: Can the authors evaluate subject-level consistency filtering as a design-specific adaptive attack?