- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SHIM embeds a compact source representation into an image before distribution to support subsequent tamper localization and recovery. A frozen DC-AE encodes the source, and an INN embeds its spatially shuffled latent. At the receiver, direct and inverse-shuffled decoding provide complementary inputs to a locator. Recovery combines source correction, global restoration, and mask-constrained fusion. Experiments cover five manipulation types on valAGE-Set and additional cross-dataset evaluations. The reported results show strong container fidelity, localization accuracy, and full-image recovery quality.
Critical strengths
-
SHIM reports strong end-to-end results on the complete 1,000-image valAGE-Set split. It achieves .910 localization F1 and 28.70 dB recovery PSNR under degradation, while maintaining 39.13 dB container PSNR. Evaluating actual UINT8 images makes these results more practically relevant than evaluations restricted to floating-point images.
-
The receiver reuses one extracted source representation for both localization and recovery. Direct decoding preserves manipulation-related inconsistencies, while inverse-shuffled decoding supplies source-aligned content. This is a coherent design with a clear purpose for each view.
Critical weaknesses
-
The contribution beyond the closest prior work is not sufficiently isolated. ReImage already combines shuffled self-embedding, INN-based extraction, contextual enhancement, and mask-based recovery [A]. RecoverMark also compresses protected content into a latent representation before embedding it for localization and recovery [B]. SHIM’s clearest distinction is therefore dual-order decoding within a compact latent framework. However, Table 4(a) removes inputs from a fixed trained locator rather than comparing independently trained single-view and dual-view models. The clean F1 gain from adding the direct view is .951 to .955, and the degraded gain is .897 to .910. These results show that the trained locator uses the additional input, but do not establish its advantage over a properly trained aligned-only alternative. Table 4(c) also changes representation, payload size, and training together, leaving the benefit of compact latent self-embedding unresolved.
-
The evaluation leaves important uncertainty about both visual fidelity and recovery quality. Figure 5 shows pronounced, spatially regular patterns in SHIM’s amplified embedding residuals, with faint texture also visible in smooth regions of the protected images. Appendix A.2 explicitly mentions minimizing grid artifacts during checkpoint selection, but does not explain their source or establish whether the remaining patterns are perceptible under normal viewing conditions. High average PSNR does not resolve this concern because it does not account for the spatial organization of errors.
The recovery comparisons also contain confounding factors. Tables 1–2 combine different stochastic generation batches for several baselines. Table 3 retains different channel orders, JPEG implementations, and quantization paths; notably, ReImage receives degradation before tampering, whereas SHIM receives it afterward. Finally, SHIM restores pixels outside the predicted repair region, so its full-image PSNR improvements can include general restoration rather than recovery of overwritten content. Separate measurements inside and outside the manipulated region are needed to distinguish these effects.
Reference
[A] Kim, M., & Seo, P. H. (2026). Robust image self-recovery against tampering using watermark generation with pixel shuffling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Findings (pp. 8877–8886).
[B] An, H., Ye, X., Hua, G., Tao, Y., Cao, H., Yu, X., & Fang, Y. (2026). RecoverMark: Robust watermarking for localization and recovery of manipulated faces. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 8587–8597).
Questions for authors
Does dual-order decoding outperform an independently trained aligned-only locator with comparable capacity and training budget? Can a controlled representation comparison separate the effect of the compact latent from changes in architecture and training?
What causes the regular patterns in Figure 5, and are they perceptible under normal viewing conditions? Please provide native-resolution crops, particularly for smooth regions, to support the claimed visual fidelity.
Do the recovery gains persist under a common evaluation pipeline with matched channel order, degradation assignments, JPEG implementation, and delivery quantization? Please also clarify whether the earlier threshold/post-processing sweep used the reported valAGE-Set test split.
How much of the recovery improvement occurs inside the annotated manipulated region? Separate inside/outside errors and a global-restoration-only comparison would clarify the contribution of embedded source information.