- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the issue of MLLM’s insufficient utilization of low-level forensic information in AIGC detection. The authors propose Native Forensic Connection (NFC), which connects forensically sensitive intermediate visual representations to specific layers of the language model via a lightweight alignment module. They also constructed the SemClean-Bench dataset to evaluate the model’s ability to recognize generated images in the absence of obvious semantic shortcuts. Experimental results show that NFC improves accuracy on SemClean-Bench, and when using a training setup closer to that of Deep-VRM, NFC-LoRA achieves 98.0% accuracy. The paper proposes a relatively concise method for integrating forensic information and investigates the low-level forensic capabilities of MLLMs from the perspectives of representation analysis and benchmark construction.
Critical strengths
-
The research perspective is novel, proposing an approach to enhance forensic capabilities by accessing native intermediate visual representations.
-
The evaluation design and ablation analysis are relatively comprehensive. SemClean-Bench constructs a targeted diagnostic benchmark to address potential shortcuts involving obvious semantic anomalies in existing generative image detection evaluations. The paper also evaluates detection performance on multiple conventional benchmarks and analyzes the effects of NFC connectivity, freezing the visual encoder, training order, fusion coefficients, and changes to the backbone model.
Critical weaknesses
-
The filtering strategy used in SemClean-Bench is not yet sufficient to demonstrate that its evaluation results primarily reflect low-level forensic capabilities. The authors need to more clearly define the scope of conclusions that this benchmark can support.
-
The experimental results cannot yet completely rule out the influence of data sources or fully demonstrate the generalization ability of NFC. The paper achieved a high average accuracy on SemClean-Bench, but there are significant differences in results among different generators.
Questions for authors
-
Does SemClean-Bench truly measure low-level forensic capabilities?
-
How can independence between the training data and the test benchmark be ensured? This primarily concerns the issue of information leakage.
-
How should the performance differences of NFC across different generators be explained?
-
Are the benefits of the two-stage training strategy statistically robust?
Dear Reviewer osLQ,
Thank you for the constructive review. We appreciate your recognition of NFC’s use of native intermediate visual representations and the breadth of our evaluation.
[W1/Q1] Evaluation scope of SemClean-Bench
A1. Thank you for raising this point. SemClean-Bench evaluates detection performance when obvious semantic shortcuts are less available, offering a complementary perspective on forensic perception. Besides, we conduct an extra visual comparison of the image and attention maps between the excluded and retained images in SemClean-Bench. As shown in Fig.5, one can see that the retained part has better visual quality and more diffuse attention patterns. On the other hand, the excluded part has conspicuous semantic anomalies that attract concentrated model attention, suggesting more dependence on obvious semantic shortcuts. We also revise the manuscript to clarify the benchmark’s evaluation scope.
[W2/Q2/Q3] Data independence and Cross-generator generalization
A2. (a) Training–test independence. We strictly follow Deep-VRM's training and evaluation settings. Notably, the four recent generators included in our benchmark are released after the training dataset is constructed and are therefore unseen during training.
(b) Cross-generator generalization. For HiDream-O1, we observe a substantial drop in fake recall from 99.8% to 63.2% after applying random post-processing to the same images. This degradation may be attributed to the disruption of subtle low-level forensic cues by post-processing operations. Improving robustness against such transformations remains an important direction for future work.
[Q4] Robustness of Two-Stage Training
A3. Thank you for raising this question. We compare Stage 1 only, Stage 2 only, and both training orders, reporting the average and standard deviation over three runs with different random seeds. Our two-stage configuration achieves the best average performance across AIGI-Now, WildRF, and Chameleon.