- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Part-Level Self-Blending (P-SBI), which generates synthetic facial manipulations with known region masks, and PARTAWARE, a detector trained to identify manipulated facial regions and localize edits. Experiments across 18 existing detectors, 21 corruption types, and independent manipulation benchmarks show strong cross-dataset transfer, robustness, and region-level detection. However, attribution results are partly replicated by a parameter-free baseline, dense localization remains imprecise, and transfer to real-world lip-sync forgeries is limited.
Critical strengths
- P-SBI provides known region masks, enabling systematic evaluation of region-level detection.
- Comparisons, ablations, corruption tests, and external benchmarks reveal both improvements and generalization limits.
Critical weaknesses
- A simple statistic with no learned parameters achieves 0.706 top-1 attribution accuracy, raising questions about whether the evaluation truly measures learned localization. Dense localization is also limited, with an IoU of just 0.192.
- Despite strong mouth-region coverage on synthetic manipulations, the model struggles to generalize to real AVLips forgeries, limiting claims about its ability to detect manipulations from real-world generators.
Questions for authors
- Which results best demonstrate that the model can identify manipulated regions from the edited image alone, without relying on pristine-image restoration or parameter-free baselines?
- Do the main performance gains hold across different training seeds and evaluation splits, especially for results reported using only a single seed?
4 comments
Thank you, and a brief follow-up
We thank the reviewer again for the careful review. To briefly summarize our reply, from the edited image alone the part head names the edited region at 0.69–0.82 over three seeds, about twice the 0.27–0.35 reached without P-SBI, and every seed beats its control. Since the discussion period ends soon, we would be grateful to hear whether our reply addresses the reviewer's concerns, and we would be glad to clarify any remaining point.
Thanks for the response. My concerns are addressed. I will increase my score to 3 (Weak accept).
We thank the reviewer for taking the time to review our comments and we appreciate their response about increasing our score.
We thank the reviewer for the detailed comments. Following the reviewer's suggestions, we ran each requested analysis, and all of them are now in the rebuttal and paper.
Weakness 1:
The new analyses show that the 0.706 statistic needs the pristine frame, while our part head names the region without it. The statistic's top-1 comes from the Shapley intervention, which restores each part from the pristine frame. Restoring an unedited part changes nothing, so the edited part receives the whole score change (Appendix L.2 calls this oracle assistance).
Table L.1 adds these rows, Section 5.2 states that 0.706 needs the pristine frame, and the floor is renamed from “parameter-free” to “training-free”, since its edited-image version fits per-part clean-frame statistics.
On dense localization we agree. The map is coarse on every seed (IoU 0.192, 0.341 and 0.361), and Section 6 now states this limit together with a confidence rule for when a part-head name can be trusted, which reaches 0.90 top-1 on the half of blends it accepts.
Weakness 2:
We agree, and the paper now scopes P-SBI accordingly. It targets local spatial edits, and mouth coverage on synthetic blends does not transfer to real lipsync forgeries. Our seeds and controls show that P-SBI brings no gain on lipsync, where the control is higher on AVLips (by 0.01 to 0.04) and on DeepSpeak in every seed (Appendix K). We think lipsync leaves its evidence in mouth motion and in generation artifacts, which a spatial blend does not model. Appendix K now treats lipsync as outside the scope of P-SBI and adds the seeds and controls. Section 6 and the Conclusion state that P-SBI targets local spatial edits, while detection of lipsync and whole-face forgeries comes from the rest of the training pipeline.
Question 1:
The part head is the direct evidence, since it receives only the edited image in one forward pass.
These are in Table L.1 and Appendices L.4 and L.5.
Question 2:
We agree with the reviewer. The region gains hold on every seed, and the paper also states plainly where P-SBI gives no gain. New Appendix F.6 (Table F.6) repeats coverage, paired shift, part-head naming, localization IoU, diffusion inpainting and the in-the-wild benchmarks with three seeds and three no-P-SBI controls. The Shapley and occlusion readouts, the confidence rule and the case figures use the reported seed.
In sum, region sensitivity and naming hold on every seed and on an unseen manipulation, and transfer is on par with the strongest published detectors. The limits of P-SBI are now stated in the main text.