- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors offer their own perspective on solving the Image Manipulation Localization (IML) task. Instead of combining heterogeneous features as equals, the authors propose a sequential refinement of the manipulation mask hypothesis. RoGRE, which maintains a shared localization state through initial proposal via DINOv3, spatial correction via SAM2, and forensic refinement via Constrained Bayar and Zero-DC SRM, using gated mechanism to generate mask manipulation.The authors evaluated RoGRE under two standard protocols: CAT-Net (four-source) and MVSS-Net, using pixel-level F1 as the evaluation metric. The method achieves mean F1 scores of 0.888 and 0.813 under the CAT-Net and MVSS-Net protocols, respectively.
Critical strengths
The problem formulation considered in the paper is relevant due to its applicability in various security and image verification systems. RoGRE demonstrates improved F1 scores on both major IML evaluation protocols compared with many recent state-of-the-art methods.
Critical weaknesses
- The Initial Localization Proposal is instantiated only with DINOv3, although several other foundation models are conceptually well suited for this role. Since no alternative backbone is evaluated, it remains unclear whether the reported gains stem from the proposed controlled-revision framework or from the specific choice of DINOv3.
- The choice of SAM2 is not justified. Both the Spatial Hypothesis Correction stage and the final decoder rely on SAM2, whereas SAM 3 (Carion et al., 2025) was publicly available well before the submission and also supports mask prompts. The paper neither motivates the choice of SAM2 nor evaluates SAM 3 in this role.
- Outdated forensic components. LFFE combines Bayar constrained convolutions (2016) with SRM residuals (2012). Noiseprint++ (Guillaro et al., CVPR 2023) serves essentially the same purpose, extracting a forensic noise residual, and originates from TruFor, which the authors already use as a baseline. The paper does not discuss why this hand-designed combination is preferred over a stronger learned residual extractor.
- (minor) The third contribution (the gated residual mechanism) is effectively a component of RoGRE, which is already covered by the second contribution.
Questions for authors
- Have the authors tried other models for the Initial Localization Proposal, e.g., CLIP, SigLIP 2, or C-RADIOv4? The latter is distilled from SigLIP 2, DINOv3, and SAM 3, so it should provide an informative general-purpose representation. It could also test whether separate semantic and structural backbones are needed at all.
- How does RoGRE perform when SAM2 is replaced with SAM 3 in the Spatial Hypothesis Correction stage (and in the final decoder)?
- How does performance change if Bayar+SRM in LFFE is replaced with, or complemented by, Noiseprint++?
6 comments
2. SAM2 Versus SAM3
We replace SAM2 with SAM3 in both spatial correction and final decoding. The resulting mean F1 is 0.890 ± 0.003, compared with 0.888 ± 0.003 for SAM2. The observed difference is small relative to the reported seed variation, so these results alone do not establish a clear advantage for SAM3.
For context, the published full-model sizes are approximately 848M parameters for SAM3 and 80.8M for SAM2 Hiera-B+. These figures describe the foundation models rather than measurements of the complete RoGRE pipelines.
These results support SAM2 as a suitable choice for the evaluated setting and show that the correction framework can also be instantiated with SAM3.
3. Learnable Forensic Features and Noiseprint++
We would like to clarify that LFFE is a trainable forensic encoder. Its Bayar filters are optimized under prediction-error constraints, and its SRM-initialized filters remain learnable under a zero-DC constraint. These residual priors guide feature extraction, while subsequent learned layers form the final forensic representation.
Following your suggestion, we evaluate Noiseprint++ both as an additional input to LFFE and as a replacement for LFFE. Noiseprint++ participates in task-specific training in both variants. Adding Noiseprint++ yields 0.883 F1, while replacing LFFE yields 0.871, compared with 0.888 for LFFE alone. Both alternatives also increase authentic-image FPR from 0.6433% to 0.9558% and 0.9312%, respectively.
Neither alternative outperforms LFFE in the tested configurations. Combined with the Bayar and SRM ablations in Table 2, these results support retaining the learned LFFE representation for forensic correction.
Response to Reviewer vs2A
We appreciate the reviewer’s thoughtful feedback and suggestions regarding alternative representations. Below we report the results for the evaluated configurations and clarify our contribution statement.
Table R4-1. Comparison of alternative representations under the four-source CAT-Net setting. All configurations follow the same training protocol. Each run is evaluated using its final-epoch checkpoint. Mean F1 reports mean ± standard deviation across five seeds, with CASIAv1, Columbia, NIST16, and Coverage weighted equally within each run.
1. Alternative Initial Backbone and Separate Spatial Encoder
We evaluate C-RADIOv4 in two configurations. The first replaces DINOv3 as the initial-proposal backbone while retaining the SAM2 image encoder, spatial correction, forensic refinement, and final decoding. The second removes the SAM2 image encoder and combines C-RADIOv4 with SAM2 decoding.
Replacing DINOv3 with C-RADIOv4 yields 0.859 mean F1, compared with 0.888 for the reference configuration. Within the C-RADIOv4 configurations, removing the separate SAM2 image encoder lowers mean F1 from 0.859 to 0.802, a 5.7-point decrease, and increases authentic-image FPR from 0.6538% to 0.7923%. This difference compares the complete representation configurations with their respective decoder interfaces. The tested configuration retaining the separate SAM2 encoder performs better.
We would like to clarify that the contribution of the correction mechanism is evaluated separately through the same-backbone ablations in Table 2. With the same DINOv3 and SAM2 backbones, moving from A1 to Full improves F1 from 0.854 to 0.888. The representation replacement experiments evaluate backbone choices, whereas the controlled ablations support the contribution of the correction design.