- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes RIFT, a region-level audit for frozen deepfake detectors on matched real/fake pairs. RIFT measures how the positive detection gap changes when a supplied region is neutralized (M), whether this dependence remains stable under predefined perturbations (Q), and combines the two in FSS. Experiments on FF++ include shared-cue controls, spatial controls, same-authenticity placebos, and intervention operators. It audits supplied regions; it does not predict manipulation masks.
Critical strengths
- Matched real/fake pairs let the authors separate a region's effect on an individual prediction from its effect on the authenticity gap. This is useful for checking whether an explanation follows shared watermarks, backgrounds, or other cues present in both classes.
- The validation includes multiple spatial controls, placebos, and intervention operators. I found it useful that the authors report failed competence gates and limited Q/FSS gains; those results make the scope of the method easier to judge.
Critical weaknesses
- High M can still arise from an interaction between unchanged context and manipulated features, so the claim of forensic specificity needs qualification. The Faith comparison changes both the reference information and the measurement design, which makes their contributions difficult to separate.
- Several validation details are still hard to verify: score-matched placebo construction, the construction of GT and spatial controls, and the competence gates for the reserved nuisances. I also could not settle how Q should be read at low signal, and the aggregation behind Table 3 needs clarification.
Questions for authors
- Can interactions between unchanged shared context and manipulated features still produce a high M? If the existing checks do not exclude that case, the "forensic specificity" claim needs qualification. It would also help to state explicitly that M measures change relative to s_f, not the fraction of the original gap removed.
- The Faith comparison changes both the availability of a real-image reference and the measurement design. Could the authors add an explanation baseline that also uses matched real/fake pairs but is not equivalent to M, while holding samples, regions, interventions, and aggregation fixed? That would separate the value of the reference from the value of RIFT's design.
- Table 9 reports gate status for the primary nuisances, but the corresponding AUCs and gate status for the reserved nuisances are unclear. Please report these and, beyond the M-adjusted analyses in Table 7, check whether the Q associations persist across M ranges and when instability is measured in absolute terms.
- How were the score-matching variables chosen and what tolerance was used? Please clarify the pairing direction and the treatment of unmatched samples. Is Matched F-R in Table 6 computed with Eq. (4), using the same samples and weights as Table 1? I could not explain why TSRL is 0.1842 in one table and 0.083 in the other.
- What is the source of "exact manipulation support", and how is it binarized and aligned to the image and intervention grid? How many samples remain in each manipulation family after the strict translated controls are constructed? These details are needed to judge whether support definitions or sample selection could drive the spatial comparison.
- In Table 3, the strength-1.00 values give 0.447 − 0.024 = 0.423, whereas ΔFSS is reported as 0.413; other rows also differ. With common samples and weights, averaging paired differences should give the same point estimate. Please clarify any differences in samples or weights and reconcile the point estimates and intervals with Section 5.1.