- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes EditR², which trains a differentiable simulator to predict how generative editing transforms watermark perturbations. The simulator provides feedback for training the watermarking network, while a residual-transfer module adapts the watermark to native-resolution images. Experiments show promising bit accuracy after instruction-guided editing.
Critical strengths
- Predicting the watermark-induced editing response provides a well-motivated learning target for the simulator.
- The paper includes component ablations and evaluations on real editors, unseen editing categories, and different image resolutions.
Critical weaknesses
-
The decision to freeze DERS is insufficiently justified. The embedder and CART continue to change during training, potentially shifting the residual distribution away from DERS’s training data. This shift is not directly evaluated, and alternatives such as alternating updates of the simulator and watermarking network are insufficiently discussed.
-
Complete-message recovery rates are missing. The evaluation primarily reports average bit accuracy, leaving unclear how often an entire message survives editing. This limits the assessment of practical provenance-tracing capability.
-
Evidence of generalization across editing models is limited. Although results are reported on two additional editors, comparable baseline results are missing. The relative advantage of the method across editors therefore remains unclear.
Questions for authors
- How accurately does frozen DERS predict real editing responses for residuals produced during later training stages? Would periodically updating DERS improve its fidelity or final watermark recovery?
- What are the complete-message recovery rates after editing?
- How does EditR² compare with the strongest baselines on the two additional editors under the same evaluation settings?
5 comments
Thank you for the detailed response. However, regarding Q2, we are discussing an alternating-update scheme with two stages:
- DERS update: The watermark embedder is frozen, and DERS is trained to fit the changes caused by watermark embedding. Watermark extraction accuracy is not used as its loss.
- Watermark training: DERS is frozen, while the watermarking network is updated.
This procedure is similar to alternating optimization in GANs. I do not see a risk of information leakage in this scheme.
Thank you for the clarification. Our previous response conflated your proposal with a different update rule in which DERS itself is optimized using the watermark-recovery objective. Our concern in that different setting was that DERS could adapt to facilitate extraction rather than faithfully model real editing responses; we incorrectly carried this concern over to your scheme. In your scheme, the watermark embedder is frozen while DERS is updated using real paired-edit responses, without using watermark extraction accuracy as its training objective. DERS is then frozen while the watermarking network is updated. We therefore agree that the response-supervised alternating scheme you describe does not inherently involve information leakage.
Our original motivation for freezing DERS was to maintain a fixed differentiable surrogate throughout watermark training, avoiding repeated calls to the black-box editor to generate paired responses for recalibration. This was a design choice to simplify the optimization process, rather than an assertion that response-supervised alternating updates are problematic.
To directly examine this alternative, we followed the two-stage alternating-update procedure you described for three rounds. We evaluated all four settings on the same held-out test set using the same evaluation protocol. As shown in the table below, periodic recalibration reduced the response-matching error (RESP) from 0.2185 for the frozen-DERS baseline to 0.2055–0.2061, corresponding to reductions of approximately 5.7%–5.9%. Meanwhile, Bit ACC remained close to the baseline value of 90.76%, ranging from 90.73% to 90.94% across the three rounds.
Evaluation of periodic response-supervised DERS recalibration.
| Setting | Bit ACC (%) ↑ | RESP ↓ |
|---|---|---|
| Frozen-DERS baseline | 90.76 | 0.2185 |
| DERS-1 | 90.73 | 0.2055 |
| DERS-2 | 90.94 | 0.2061 |
| DERS-3 | 90.87 | 0.2059 |
DERS-1, DERS-2, and DERS-3 denote the results after the first, second, and third rounds of the complete alternating-update procedure, respectively.
These results indicate that periodic recalibration improves DERS’s response-prediction fidelity on unseen samples, but does not necessarily lead to improved final watermark recovery: the lower RESP did not yield a consistent gain in Bit ACC in our experiments.
Given this trade-off and the additional black-box editor calls required to generate paired responses, we retain frozen DERS as a simple default in our current framework, while recognizing periodic recalibration as a reasonable alternative when further improving response-prediction fidelity justifies the additional editor calls.
We will revise the manuscript to clarify the distinction between the two update strategies, explain the motivation for freezing DERS in our current framework, and report the results of this alternating-update evaluation.
Response to Reviewer ZxMz
We sincerely thank the reviewer for the careful review of our paper and the valuable feedback.
Q1: How accurately does frozen DERS predict real editing responses for residuals produced during later training stages?
A1:
We evaluate DERS using the response-matching error (RESP) defined in Eq. (5), which measures the discrepancy between predicted and real editing responses (lower is better).
DERS is pretrained on paired edits generated by Qwen-Image-Edit, with 400 pairs per seen editing category. To evaluate its prediction fidelity after Stage-II optimization, we construct new paired editing samples using residuals generated by the final Stage-II embedder and CART, and test on 300 unseen images for each of Qwen-Image-Edit, JoyAI-Image-Edit, and Doubao-Seedream-4.5.
As shown in Table 1, the test RESP values are comparable to the training value. These results demonstrate that frozen DERS maintains good response-prediction fidelity after Stage-II optimization, including on unseen editors.
Table 1: Response-matching error (RESP ↓) of frozen DERS on training and held-out images.
Q2: Would periodically updating DERS improve its fidelity or final watermark recovery?
A2:
In the end-to-end embed–distort–extract training framework, the distortion layer should remain independent of the watermarking task to faithfully simulate external distortions in real-world scenarios. Generative image editing, as a form of distortion, follows the same principle. In practice, generative image editing occurs independently of watermark embedding and extraction, and real editors do not adapt themselves to improve watermark recovery. Therefore, maintaining the independence of the distortion layer better reflects realistic image editing scenarios.
If DERS is jointly optimized with the embedder, extractor, and CART under the same watermark recovery objective, the distortion layer may gradually adapt to facilitate watermark extraction rather than faithfully simulate real editing distortions. In extreme cases, it might even learn to apply no effective distortion. Even with alternating updates, this risk cannot be eliminated as long as DERS is optimized under the same watermark recovery objective. Therefore, we pretrain DERS on paired real-editor responses and freeze its parameters during Stage II, while allowing gradients to propagate through DERS to optimize the embedder and CART, with the extractor jointly trained.
Q3: What are the complete-message recovery rates after editing?
A3:
The exact-message recovery rate (EMR) is less commonly used as the primary metric for multi-bit watermarking, as even a single bit error causes the entire message to be considered incorrect. In contrast, bit accuracy (ACC) provides a more informative measure of watermark robustness under distortions.
Nevertheless, we additionally evaluate EMR after generative editing, following the same evaluation protocol as in the main paper. As shown in Table 2, EditR² achieves the highest EMR, demonstrating its relative advantage in complete-message recovery.
Table 2: Exact-message recovery rate (EMR, %) after generative editing.
Q4: How does EditR² compare with the strongest baselines on the two additional editors under the same evaluation settings?
A4:
To ensure a fair comparison, we evaluate EditR² and the baselines on JoyAI-Image-Edit and Doubao-Seedream-4.5, following the same evaluation protocol and settings as in the main paper.
As shown in Table 3, EditR² achieves the highest mean bit accuracy on both editors, outperforming the strongest baseline, Robust-Wide, by 4.86 and 5.55 percentage points, respectively. These results further demonstrate the effectiveness of EditR² and its cross-editor generalization without retraining.
Table 3: Cross-editor comparison under identical evaluation settings. Mean bit accuracy (ACC, %) ↑.