- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RepMark, a representation-stable latent watermarking framework designed to trace the use of protected images in downstream diffusion models. The key idea is to improve radioactive watermark propagation through two mechanisms: (1) shared writing coordinates established by a frozen VAE, which allow the same message to induce a carrier-independent latent displacement across images, and (2) cross-representation verification, implemented using a private LoRA-adapted encoder and a proxy-VAE training path, to improve watermark recovery after representation changes. RepMark supports three deployment scenarios: post-processing, in-processing, and training-data protection.
The authors evaluate RepMark through fine-tuning and training-from-scratch experiments using PixArt and LightningDiT, with additional tests involving an unseen SD3.5 VAE. Results show strong watermark detection and message recovery under several settings, including near-perfect detection in some model-training experiments. The paper also studies the effects of the protected-data fraction, training budget, query aggregation, and image-processing attacks. Overall, the work presents a unified framework for latent watermarking and model-level tracing, while its effectiveness depends on the downstream training regime and the proportion of protected training data.
Critical strengths
A coherent design for radioactive watermark propagation. RepMark explicitly addresses both cross-sample writing consistency and cross-representation recovery. The use of shared VAE writing coordinates and proxy-representation training provides a technically motivated approach to improving watermark inheritance, rather than treating image-level detection as sufficient evidence of model-level propagation.
Broad and informative empirical evaluation. The experiments cover both fine-tuning and training from scratch, multiple resolutions and training budgets, varying protected-data fractions, and an unseen VAE representation. The results also distinguish watermark presence detection from message recovery, providing a more informative evaluation of model-level watermark propagation than a single detection metric.
Critical weaknesses
The practical assumptions behind black-box attribution need stronger validation. In the model-level evaluation, the authors train two separate models under matched settings: a protected model trained on watermarked data and a clean reference model trained on unwatermarked data, using the same architecture, dataset, and training protocol. The clean reference model is then used to calibrate the detection threshold for identifying watermark evidence in the protected model's outputs. While this provides a controlled evaluation, it remains unclear how the threshold can be reliably calibrated when an auditor has access only to a black-box third-party model and cannot obtain a suitably matched clean reference model or its training details. Such limitations may affect the false-positive rate and weaken the practical applicability of the proposed attribution method.
The empirical evidence for the method's comparative advantage is incomplete. RepMark performs strongly, especially at early training stages, but learned baselines such as TrustMark-Q and Watermark Anything also achieve near-perfect detection under some training-from-scratch settings. In addition, the image-quality comparison uses different reference conditions for RepMark and post-processing baselines, making direct comparisons difficult. More carefully matched comparisons would help establish whether the proposed design offers a consistent advantage in propagation, robustness, and visual quality over existing approaches.
Questions for authors
Black-box attribution and calibration: The evaluation uses separately trained clean-reference students with the same architecture, data, and training protocol as the protected students. Can the authors clarify whether this matched reference is required for threshold calibration? If the clean reference is unavailable, or if the target model uses a different training dataset or recipe, how does RepMark distinguish watermark inheritance from naturally occurring detector responses? Results under a more realistic reference-free or mismatched-reference setting would substantially affect my assessment of the practical attribution claim.
Comparative advantage and evaluation fairness: Since TrustMark-Q and Watermark Anything also achieve very high detection performance in some training-from-scratch settings, what specific conditions demonstrate a statistically reliable advantage of RepMark beyond early detection? Can the authors provide matched comparisons using the same protected-data fraction, training budget, and image-quality reference protocol, with variability across independent seeds? This would help determine whether the proposed design provides a robust advantage over existing methods rather than a setting-dependent improvement.