- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper targets the limitations of traditional binary image forgery localization, which only distinguishes real and fake pixels but fails to identify diverse forgery types and locate mixed tampered regions in a single image. The authors make two core contributions: a large-scale benchmark dataset ForgePan-5.9M with 5.975 million annotated images covering natural scenes, physical editing, multiple AI editing modes, and hybrid tampering, and a panoramic segmentation-based ForgeFormer model built on DINOv3. The proposed method unifies image-level forgery type classification and pixel-level tampering source localization, and adopts multi-scale feature fusion, mask projection, supervised contrastive learning and deep clustering to optimize fine-grained forgery reasoning. Extensive experiments on in-domain test sets, cross-generator benchmarks, and the IEDAL2 hidden test verify the effectiveness and generalization ability of the method for complex hybrid image forgery detection.
Critical strengths
-
Novel and practical task formulation: Different from conventional binary forgery segmentation, this work redefines image forgery detection as a multi-source panoramic segmentation task. It enables the model to distinguish physical editing, different AI editing styles and hybrid tampering regions simultaneously, which better fits real-world complex forgery scenarios.
-
Systematic dataset construction: The ForgePan-5.9M dataset adopts a well-designed aligned editing strategy, applying various tampering operations on identical mask regions. This design mitigates the confounding bias between content features and forgery traces, providing a high-quality and balanced benchmark for fine-grained image forensic research.
-
Task-aligned model architecture: The ForgeFormer model integrates DINOv3 pre-trained features, multi-scale feature pyramids, iterative mask projection, and auxiliary contrastive learning and clustering constraints. Ablation experiments fully validate the positive contribution of each core module to multi-source forgery localization.
-
Comprehensive experimental evaluation: The paper conducts extensive evaluations including in-domain quantitative results, cross-generator generalization tests, public benchmark comparisons, hidden blind tests on IEDAL2, ablation studies, and robustness tests against common image post-processing, demonstrating solid overall performance.
Critical weaknesses
-
Unverified causal effectiveness of aligned data construction: The core claim that mask-aligned editing improves generalization lacks strict controlled experiments. The current dataset cannot exclude interfering factors such as inconsistent generator characteristics, boundary fusion strategies and compression differences across editing branches, so the genuine promotion mechanism of the aligned design is unproven.
-
Limited generalization from synthetic to real-world scenarios: Most training and test data are synthetically generated under fixed pipelines. The obvious performance drop on the IEDAL2 hidden test (pixel-level F1 drops to 60.3%) reveals a significant gap between synthetic data performance and real complex tampering scenarios with multi-round editing and arbitrary post-processing.
-
Inadequate interpretability of auxiliary modules: The online deep clustering module brings performance gains, but the paper fails to verify whether the clustered features correspond to intrinsic forgery fingerprints of different generators. The actual working mechanism of this module remains ambiguous.
-
Asymmetric baseline comparison and incomplete evaluation: Traditional binary segmentation baselines lack the multi-source classification output space, leading to unfair performance comparison. Besides, the model’s fine-grained errors (e.g., misclassification of tampering sources, boundary deviation) and performance under complex combined perturbations are not fully analyzed.
-
High training and deployment costs: The model relies on a large DINOv3 backbone and multiple auxiliary training objectives, requiring high-end GPU resources for long-duration training. The paper lacks efficiency analysis of model parameters, inference latency and lightweight deployment potential, limiting its practical application value.
Questions for authors
Please refer to the weaknesses.