- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how to extract forgery-detection cues from frozen pretrained visual encoders. LayerProbe uses layer-wise linear probing and greedy fusion across 14 ViT backbones to identify useful, complementary layers. The results show that the best readout depth varies across backbones and that individually weaker layers can improve a combined readout. Building on these findings, ForenLens uses shared cross-attention and image-dependent layer routing to retrieve evidence from a fixed set of selected layers. Four forensic priors guide query attention during training, while a free query is intended to capture information beyond these priors.
Critical strengths
I find the idea of extracting forgery-detection cues already present in pretrained visual encoders convincing. Investigating where these cues can be read and how to retrieve them effectively is a worthwhile direction.
Critical weaknesses
My main concern is how well the selected layers, encoder-specific readout, and predefined expert priors remain useful when conditions change. The paper aims at generalization, but its implementation still depends on these choices. The reported OOD results support the tested configuration; they do not fully address how these choices hold up when the source data, encoder, or generation mechanism changes.
-
Layer selection depends on the available forgery data, but the paper does not compare results when the source data used for selection changes. For example, with CLIP fixed, would LayerProbe select the same layers when run separately on AIGC, Deepfake, and image manipulation data? How would those layer sets perform on the same unseen test set? Table 6 tests OOD transfer after selection on OpenMMSec, but does not answer how much the selected layers and their benefits depend on the forgery types in the source data.
-
Layer selection is the foundation of the method, and it is tied to the visual encoder. The paper evaluates 14 encoders, but performs probing, selection, and readout training separately for each. This demonstrates that the same design can be trained with different encoders; it does not demonstrate direct reuse of the selected layers or trained readout across encoders. Following the proposed procedure, changing the encoder still requires these adaptation steps.
-
Once selection is complete, dynamic routing can only reweight the selected layers; it cannot add other layers as readout sources. Its scope is therefore determined by the fixed selection. The default of four layers also lacks sufficient justification. The reported comparisons cover one to four layers, with no results for five or more. In Table 20, SigLIP2 achieves 93.6% mean AP with two layers, compared with 93.2% with four. These results show that multiple layers help, but do not explain why four should be the default across encoders.
-
The coverage of the expert priors for fully generated images needs clarification. Images generated without local splicing or editing do not necessarily contain tampering boundaries or locally inconsistent compression histories. For an example such as GPT-Image2.5, which I am concerned about, the paper reports no dedicated evaluation. Not all four experts target local manipulation: SD-VAE reconstruction error is also used to analyze generated images, but it relies on a fixed autoencoder. The results do not fully establish when these predefined priors remain informative across different generation mechanisms. This is a concern about their coverage, rather than evidence that the detector already fails on that particular generator.
Questions for authors
No questions. I would like the authors to reconsider the paper’s contributions and how they are presented.
7 comments
Official Comment by Authors Part2
W4 (Fully generated images)
- Fully generated images also exhibit artifacts in local regions, as studied in AutoGAN (WIFS'19 [2]), CNNDetection (CVPR'20 [3]), and NPR (CVPR'24 [4]). Likewise, reconstruction error from a fixed pretrained model remains informative across unseen generation mechanisms on fully generated images, as demonstrated in DIRE (ICCV'23 [5]), AEROBLADE (CVPR'24 [6]), and DRCT (ICML'24 [7]).
- The benchmark
AIGI-Now(AIGI-PandAIGI-S) already evaluates 9 modern generative models, including GPT-4o, Nano Banana, FLUX Pro, FLUX Dev, FLUX Kontext, FLUX Krea, Jimeng, Kling, and MiniMax. The fake samples from these generators in AIGI-P and AIGI-S are fully generated images. On AIGI-P and AIGI-S, ForenLens with SigLIP2 achieves 95.6% and 89.7% AP, respectively. We will add the version and complete generator list to the revised manuscript.
References
[1] Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations, 2022.
[2] Xu Zhang, Svebor Karaman, and Shih-Fu Chang. Detecting and Simulating Artifacts in GAN Fake Images. In IEEE International Workshop on Information Forensics and Security, pages 1–6, 2019.
[3] Sheng-Yu Wang, Oliver Wang, Richard Zhang, Andrew Owens, and Alexei A. Efros. CNN-Generated Images Are Surprisingly Easy to Spot... for Now. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8695–8704, 2020.
[4] Chuangchuang Tan, Huan Liu, Yao Zhao, Shikui Wei, Guanghua Gu, Ping Liu, and Yunchao Wei. Rethinking the Up-Sampling Operations in CNN-based Generative Network for Generalizable Deepfake Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 28130–28139, 2024.
[5] Zhendong Wang, Jianmin Bao, Wengang Zhou, Weilun Wang, Hezhen Hu, Hong Chen, and Houqiang Li. DIRE for Diffusion-Generated Image Detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 22445–22455, 2023.
[6] Jonas Ricker, Denis Lukovnikov, and Asja Fischer. AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9130–9140, 2024.
[7] Baoying Chen, Jishen Zeng, Jianquan Yang, and Rui Yang. DRCT: Diffusion Reconstruction Contrastive Training towards Universal Detection of Diffusion Generated Images. In Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 7621–7639, 2024.
We look forward to your responses
Dear Reviewer aBB2,
We have provided point-wise clarification and experiments (upon your request) for all your concerns. We look forward to your reply and hope that our responses could address your concerns. Your time and effort is very much appreciated.
Best Regards
Official Comment by Authors Part1
We thank the reviewer for the constructive feedback and address the four concerns below.
W1 (Selection source sensitivity)
We ran LayerProbe separately on each single source domain in OpenMMSec (
AIGC,Deepfake,IMDL, andDocument), following the settings of Table 6.Across all settings, LayerProbe consistently improves over the single-layer baseline on OOD test split. Because adjacent ViT blocks share similar features (see
xWc2 - W2&Q2), the exact block indices naturally vary by probe domain, yet almost all settings select a mix of early/middle and deep blocks. The only exception is SigLIP2 probed on AIGC-only, which focuses on middle-to-deep blocks because its final block alone is already strong on AIGC. Consequently, it gives the smallest gain, whereas probing across all four domains achieves the highest overall OOD AUC among the source-selection settings shown.W2 (Backbone adaptation)
As stated in the main text (Sections 1 and 4.1), ForenLens is a general architectural design across diverse ViT backbones, rather than a fixed module reused across encoders without training. Similar to methods such as LoRA (ICLR'22 [1]), which fit lightweight parameters to each frozen model, adapting the layer selection and readout to each frozen ViT is standard for a general framework.
W3 (Choice of K=4)
We extended the LayerProbe and 8-Group experiments up to K=10.
In LayerProbe, multi-layer combinations (K≥2) consistently outperform single-layer baselines. Beyond K=4, the marginal gains from further increasing K diminish, and larger K does not consistently improve ForenLens.
K is a fixed hyperparameter, and incremental readout schemes that support a dynamic K are beyond the scope of our current design. Across backbones, the optimal K varies and balances accuracy, routing difficulty, and compute cost. We use K=4 as a shared, compact layer budget across all 14 backbones, without tuning K separately for each backbone (which is also why Table 1 reports K=4 for SigLIP2 rather than the higher-scoring K=2).