- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes SRW, a watermarking method for latent diffusion images that embeds a continuous representation of provenance text rather than a discrete identifier. The provenance payload is separate from the generation prompt. A frozen text encoder and learned attention readout produce a pooled embedding, which a learned injector maps to a latent perturbation. An image-side decoder recovers the embedding, and cosine similarity is used to retrieve related payloads from a candidate bank, with a rejection threshold calibrated on held-out negatives.
Experiments on Stable Diffusion 1.5 report robustness to several image transformations, retrieval of paraphrases and semantically related records when the exact source text is absent, and performance across different bank sizes. However, the paper states that the reported values are aggregate results inherited from an earlier workbook, while important protocol details, raw outputs, and quantitative ablations are unavailable or unverified.
Critical strengths
None
Critical weaknesses
W1. Missing evaluation protocols and underlying records prevent the central results from being assessed reliably. The paper explicitly states that its numerical results are inherited from an earlier experiment workbook and have not been independently reverified. Sample counts, seeds, raw predictions, and uncertainty estimates are unavailable. More fundamentally, the relevance-label and negative-pool construction underlying the retrieval and detection metrics remains unresolved. The definition of the “Random” category, several transformation settings, and the baseline adapters also require recovery or verification from the original records. Without these details, it is unclear what constitutes a successful retrieval or how the reported methods were compared. The bank size used in the attack sweep is unspecified, although Table 6 shows that retrieval accuracy depends on bank size. No quantitative ablations support the attention selection, injection mechanism, loss terms, or hyperparameter choices. Moreover, the motivating setting combines image distortion with the absence of the exact source record, but these conditions are evaluated separately. The payload-binding control and several additional robustness results are reported only qualitatively. These are substantive evidence gaps, rather than presentation issues alone. Unless the original experimental records can be recovered, assessing the headline claims would require rerunning the experiments under clearly specified protocols.
W2. The comparisons do not establish the claimed advantage of semantic payloads. HiDDeN and RingID do not directly encode semantic relationships, so their low performance in the source-absent semantic retrieval setting does not, by itself, establish an advantage over a complete identity-based retrieval system. A more informative alternative would decode an identity, retrieve its retained metadata, and use that metadata for semantic search. The paper acknowledges this alternative but does not evaluate it. Such a comparison must also specify whether source absence refers to the retrieval bank, the metadata store, or both. The practical tradeoff is similarly unclear. The paper reports a single fidelity operating point, with PSNR 25.64 dB and SSIM 0.8152, but no retrieval–fidelity curve as injection strength varies. The existing results therefore do not establish whether the semantic benefit justifies the image distortion. Finally, the related-work discussion does not address closely related semantic-watermarking approaches such as SEAL and OF-SemWat. Their objectives need not be identical to SRW’s, but the paper should explain the distinction between content-derived watermarking and independently specified provenance payloads. The principal concern is not the absence of uniformly superior results; it is that the comparisons do not isolate or substantiate the claimed contribution.
Questions for authors
Q1. Evaluation protocols and recoverability of results. For Tables 1, 2, 3, 5, and 6, please specify the query counts, bank sizes and composition, relevance-set construction , negative pools for AUROC and FPR95, transformation settings, and seeds. Which details and per-query results can be recovered from the original runs, and which would require new experiments?
Q2. Identity watermark with retained metadata. How does SRW compare with an identity watermark linked to a metadata database, followed by semantic search over candidate records? Please use matched transformations and candidate banks, and distinguish removal of the source from the retrieval bank from removal of its metadata mapping.
Q3. Combined distortion and source absence. What are Recall@1 and rejection rates when the exact source record is absent and the image is also distorted, for example by JPEG 50 or the tested crop? Please define the relevance criterion and threshold-calibration protocol for this setting.
Q4. Component contributions and fidelity tradeoff. Is quantitative evidence available for attention selection versus mean pooling, the individual loss terms, and latent versus pixel injection? How do retrieval performance and PSNR/SSIM vary with injection strength ?
Q5. Payload binding and relation to prior work. In the shuffling test, how often does the decoder favor the embedded payload over the generation prompt , and across how many examples? How does SRW’s independently specified provenance payload differ from the semantic information used by SEAL and OF-SemWat?