- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SpectralCanary protects an image collection by blending the low-frequency spectrum of one secret canary image into every image of the collection, then checks a suspect T2I model by scoring its generated images with a verifier trained on original-protected pairs. Across eight Pokemon settings, SpectralCanary achieves the highest average TPR at 1% FPR among the evaluated methods, and across five domains the protected images stay close to the originals while detection remains high.
Critical strengths
- The motivation is clear, the threat model is well defined, and the experiments support the design choices.
- The matched-energy band ablation is informative. Frequency-band robustness is studied in classical watermarking, but the transfer of a low-frequency trace through T2I fine-tuning is a new observation.
Critical weaknesses
- Overall novelty is low, and the method section and the contribution list do not separate the borrowed components from the new ones. The audit pipeline and the verifier design follow DIAGNOSIS and EnTruth, but Sec. 2 cites neither, and frequency-domain watermarking is not cited at all. These components need citations where the method uses them, so that the new contribution is isolated.
- Although the paper is clear, the writing is very dense. For example, instead of restating numbers every time, stating the interpretation and giving numbers only when it is necessary, would make the paper easier to read.
- The dependence of the framework on the canary image is not analyzed sufficiently. All main experiments use one fruit image, and only the band ablation uses three canaries. This may affect the validity of the framework vastly.
Questions for authors
- How much do the main results vary across independently chosen canary images, and how should an owner choose the canary?
6 comments
Follow-up discussion
We thank the reviewer again for the thoughtful review. Our rebuttal provides clarifications and additional experiments addressing the two main concerns: (1) the novelty of frequency-selective trace transfer through generative fine-tuning, supported by our comparison with the existing Tree-Ring frequency-domain watermarking method, and (2) Analysis on the dependence of detection performance on canary choice
As the discussion deadline approaches, we would be happy to clarify any further questions. We hope these clarifications and additional results help address your concerns. If your concerns have been resolved, we would appreciate it if you could reconsider the assessment with additional evidence.
Thank you for your efforts during the rebuttal period. I have read your responses and the revised manuscript. Several of my concerns remain:
- My original comment that "frequency-domain watermarking is not cited at all" was not a request to add a frequency-domain watermarking method as a baseline. My point was that the main observation, "low-frequency visual structure is an effective carrier," follows the same principle as conventional frequency-domain watermarking. As for the Tree-Ring comparison, Tree-Ring embeds its pattern in the Fourier space of the initial noise latent and detects it via DDIM inversion. It is therefore expected that this pattern does not transfer through fine-tuning on reconstructed training images, so this comparison does not provide strong evidence for the novelty of the proposed approach.
- I agree that showing low-frequency signals transfer well through T2I fine-tuning is a new empirical observation. However, the method itself (blending a low-pass-filtered canary into every image, followed by the classifier-based verification and KS-test procedure from prior work) offers limited methodological novelty.
- The new results of canary choice show that detection performance varies non-negligibly with canary choice (TPR@1% FPR from 88.0% to 99.2%). The trace strength likely depends on how much the canary's low-frequency content differs from the dataset's low-frequency content. If so, the canary should be chosen according to the target dataset. However, the revision only shows empirically that the choice matters. The proposed regional-color-contrast heuristic rests on five canaries and is not validated. In addition, Table 12 does not state which canary image, dataset, and architecture were used.
- For the dilution experiment requested by Reviewer 98oA (Appx. D.3), the source of the unprotected images does not seem to be described. Please let me know if I missed it. Appendix D.3 fixes the number of protected images (and their exposure), and Appendix D.4 shows the partial-use experiment. From my own perspective, the partial-use experiment seems more informative for practical scenarios. However, in Appendix D.4, performance is stable down to 50% but drops sharply as the number of protected images decreases further (TPR@1% FPR of 81.15% at 25% and 60.74% at 10%). This suggests that the scale of the protected collection is a key factor and an important limitation of the method.
Rebuttal by Authors
We thank the reviewer for recognizing the clear motivation, well-defined threat model, experiments supporting our design choices, and informative matched-energy ablation. We especially appreciate the reviewer's recognition that low-frequency trace transfer through T2I fine-tuning is a new observation. In what follows, we address all reviewer's concerns.
We thank the reviewer for highlighting the need to distinguish established components from our contributions. We agree that the general dataset-use auditing framework and classifier-based verification build on prior work, including DIAGNOSIS and EnTruth. In the revision, we explicitly cite these methods alongside the verifier formulation, cite Tree-Ring when discussing frequency-domain watermarking (Sec. 3), and revise the contribution list to distinguish borrowed components from our contributions
Our novelty lies in designing an effective and efficient frequency-selective canary that survives generative fine-tuning, rather than the general auditing pipeline. Specifically, we demonstrate that weak, shared low-frequency signals can remain detectable in newly generated outputs after T2I fine-tuning while preserving image fidelity. This behavior is non-obvious, as simply adding frequency-domain signals does not guarantee their transfer through model training.
We adapt Tree-Ring by applying inversion-based watermarking and reconstruction to existing training images, fine-tune SD1.5 on the resulting dataset, and evaluate generated outputs using the Tree-Ring detector. We additionally blend reconstructed watermarked images with the originals to reduce distortion.
These results illustrate that adapting generation-time frequency-domain watermarking does not automatically achieve effective, fidelity-preserving dataset-use auditing. Together with our matched-energy frequency-band ablations, they support the distinct contribution of SpectralCanary. To our knowledge, prior work has not established this frequency-dependent traceability mechanism for dataset-use auditing through generative fine-tuning.
Thank you for your comment. In the revision, we reduce repetitive numerical descriptions, emphasize the interpretation of results, and improve the organization of the main text.
Thank you for this valuable comment.
SpectralCanary maintains strong detection across five independently selected canaries, although performance varies with canary choice. We conduct additional experiments using five semantically diverse canaries under identical settings.
AUC remains consistently high across all five canaries (0.9904–0.9990), with TPR@1% FPR ranging from 88.0% to 99.2%, while all choices retain high image fidelity.
Regional color contrast offers a preliminary selection heuristic. Our exploratory analysis suggests that canaries with stronger regional color contrast (measured by average pairwise CIELAB distance across a 4×4 grid) tend to achieve higher traceability. Thus, dataset owners may consider selecting canaries with diverse regional color structure, although broader experiments are needed to validate this heuristic.