- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
FROST improves watermark recovery without modifying the pretrained encoder or decoder, requiring only a lightweight additional module.
The complete framework improves CLIC PSNR from 29.10 to 33.66 dB and achieves modest gains in average bit accuracy under the evaluated corruptions.
Critical strengths
FROST improves watermark recovery without modifying the pretrained encoder or decoder, requiring only a lightweight additional module.
Critical weaknesses
-
Experiments mainly compare against RoSteALS (Workshop paper), without evaluating stronger recent watermarking methods such as TrustMark, VINE, MBRS (MM21) and FIN (AAAI23). The results therefore do not establish competitiveness with the current state of the art.
-
The FROST Module alone decreases PSNR, while most fidelity improvements arise after reconstruction-error correction and residual filtering. A crucial baseline applying these two operations directly to RoSteALS, without the learned module, is missing. Additionally, the ablations use different effective batch sizes, and all test images share a single fixed 100-bit message. These limitations weaken the conclusions about individual components and message generalization.
Questions for authors
Can the authors provide comparisons with stronger recent methods under matched image resolution, payload, image quality, and JPEG compression settings (e.g., Q50 and Q70)?
What performance can be achieved by applying reconstruction-error correction and B0 removal directly to RoSteALS, without training the FROST Module?
2 comments
Clarification on VQ-GAN Adapter Checkpoints (A_orig and A_ref)
We would like to clarify the training configurations of the two VQ-GAN adapter checkpoints referenced in our responses.
Both checkpoints were trained for 20,000 optimization steps using AdamW (weight decay 1e-4, betas 0.9/0.999). However, A_orig used a global batch size of 8 and learning rate of 8e-4 (160K image presentations), whereas A_ref used a global batch size of 4 and learning rate of 4e-4 (80K image presentations).
A_orig was used for the latest cross-system benchmark, while A_ref was used for the separate VQ-GAN module-free controls, random-message evaluations, and quality-matched analyses.
These checkpoints are not training-seed replicates or equal-budget runs. All R0/R2/R5 comparisons within the A_ref control study share the same frozen RoSteALS backbone and evaluation conditions. We do not combine results across these checkpoints to estimate the contribution of the learned module.
This clarification does not change any reported experimental results or conclusions.
Response to Reviewer efzo
We appreciate the reviewer's valuable suggestions regarding modern baselines and evaluation fairness. We added further comparisons and controlled experiments to clarify the strengths and limitations of FROST.
1. Recent methods, matched conditions, and JPEG Q50/Q70
We re-evaluated seven systems on one server with a shared evaluation codebase. Selected CLIC results are shown below. PSNR is in dB; accuracy is in %. IC-all averages 15 ImageNet-C types at severities 3 and 5; explicit JPEG Q50/Q70 are separate tests.
These are measured operating points, not fully matched payload/quality comparisons. The common ImageNet-C branch retains the predefined 256→224→corruption→256 operator used in FROST training; explicit JPEG uses a separate branch. Removing resizing changes that attack. Each pretrained model retains its original training augmentations.
Quality-matched evidence. A separate CLIC-530 study uses A_ref, distinct from A_orig above. At PSNR 35 dB, FROST−VINE-R is +4.8 pp [4.5, 5.1] in IC-all but −2.1 pp [−2.4, −1.9] in mean JPEG Q50/Q70. Both share the 256-pixel, 100-bit setting. Against TrustMark-Q at 35 dB, Q50 is −0.78 pp [−1.11, −0.45] and Q70 is −0.64 pp. Brackets are 95% paired image-bootstrap CIs.
Auxiliary IC-all differences against MBRS-256, FIN-HEAVY, and FIN-JPEG are +14.9/+8.0/+9.5 pp at 35 dB. MBRS uses 256 bits (100 input bits plus deterministic extra bits); FIN uses 128-pixel images and 64 bits, so these are not fully payload/resolution-matched comparisons. PSNR matching also does not match LPIPS. These results identify protocol-specific strengths and limitations rather than universal superiority.
2. REC+B0 without the learned module
We directly compared module-free REC+B0 (R2) with Full FROST (R5), sharing the same reconstruction correction and filter. This separate VQ-GAN control uses A_ref, paired images/messages/attacks, 256-pixel images, and image-specific random 100-bit messages.
On CLIC-530, R2 gives PSNR 34.95 dB, LPIPS 0.0120, and IC-all 90.22%; R5 gives 34.29 dB, 0.0186, and 92.27%. R5−R2 is +2.05 pp [1.97, 2.13]. On MetFaces-1,336, the gain is +2.32 pp [2.27, 2.37], again at worse PSNR/LPIPS. These CIs refer to this paired control, not the latest benchmark.
Thus fixed processing provides most fidelity gains, while the learned module improves recovery at these operating points. This control alone does not establish an equal-distortion advantage.
3. Random messages
Original training already sampled a random 100-bit message per sample; the fixed seed-42 message was an evaluation restriction. We now assign a different random message to each image and repeat assignments five times on CLIC-530 and four on MetFaces-1,336. Methods share image/message/attack pairs; attacks on one watermarked image recover the same embedded payload.
A_ref's mean IC-all gains over R2 are +2.00/+2.32 pp on CLIC/MetFaces and are positive in every assignment. This tests message generalization with fixed checkpoints; it does not measure training-seed uncertainty.
4. Matched-budget ablations
We retrained VQ-GAN variants using global batch 4, 20,000 updates/80K image presentations, the same MIR list, AdamW, effective learning rate 4e-4, and frozen RoSteALS weights. These controlled checkpoints differ from both A_orig and A_ref.
Across three default-model seeds, IC-all ranges are 0.58/0.57 pp on CLIC/MetFaces; most component differences are smaller. Removing external LPIPS raises recovery accuracy at a substantial perceptual cost, with only one seed for that variant. Matching the budgets removes the original optimization confound, but the results do not establish that every internal component is necessary or every variant has converged.