- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SCORE, a semantic-conditioned refinement framework for generalizable AI-generated image detection. The method addresses the challenge that forensic cues may have different discriminative meanings depending on the visual context. SCORE consists of two stages: Semantic-Conditioned Primary Prediction (SCPP), which uses feature gating to produce a context-dependent primary prediction, and Instance-Conditioned Soft-Orthogonal Refinement (ISOR), which constructs a sample-specific orthogonal subspace to refine forensic representations. An uncertainty-aware mechanism then applies a bounded correction to the primary prediction. Experiments on cross-dataset face forgery detection and UniversalFakeDetect demonstrate improved generalization performance.
Critical strengths
The proposed method is evaluated across different forensic scenarios, including AI-generated image detection and deepfake detection, demonstrating its applicability to diverse forgery detection tasks.
Critical weaknesses
- The paper does not clearly explain whether the orthogonal subspace learned by ISOR represents semantic information or forensic cues, making its underlying mechanism difficult to understand. Moreover, the soft-orthogonal attenuation only removes 25% of the projected component. Why is this ratio chosen, and what advantages does it offer over directly using the original features?
- Why does Baseline + SCPP perform worse than the baseline, while combining SCPP with ISOR improves performance on UFD? The paper lacks a convincing analysis of the interaction and complementarity between these two modules.
- The current ablation studies are insufficient to justify the necessity of the various auxiliary loss functions and hyperparameter choices. More detailed analysis is needed to clarify their individual contributions.
- The presentation of experimental results should be more consistent. Some tables report values as percentages, while others use decimals. A unified reporting format would improve readability.
Questions for authors
Please refer to the Weaknesses section above for detailed questions and concerns, particularly regarding the interpretation of the ISOR subspace, the interaction between SCPP and ISOR, and the justification of auxiliary losses and hyperparameter choices.
Clarifications on soft attenuation and module interaction
Thank you for the constructive questions. On the fixed 34,400-image UFD list, SCORE achieves 95.23% mAcc and 99.55% mAP, improving over our internal Baseline by 4.74 and 0.71 percentage points, respectively. ISOR-only provides a 3.14-point mAcc gain, and adding SCPP yields a further 1.60-point gain.
1. Subspace interpretation and soft attenuation. For an image feature z, ISOR constructs an orthonormal basis Q and projector P=QQ⊤. The feature decomposes into Pz and (I−P)z. The projection-energy objective constrains their relative magnitudes without assigning semantic or forensic labels to the basis directions. We therefore interpret the subspace as an image-conditioned geometric refinement view, rather than an explicitly identified semantic or forensic subspace.
The refinement head receives
r=(I−P)z+(1−α)Pz.
With α=0.25, this preserves the orthogonal complement and 75% of the projected amplitude. The rationale is to change the relative weighting of the two components while keeping information from both available to the refinement head. The separate 0.25-logit correction cap constrains the resulting adjustment to the primary prediction.
We use α=0.25 as a shared setting across Face and UFD. This is a conservative design choice; the current component ablations evaluate the complete refinement module and do not establish that 0.25 is optimal or isolate its advantage over using the original feature (α=0). We will clarify this distinction between design rationale and experimental evidence.
2. Interaction between SCPP and ISOR. The matched evaluation on the fixed UFD list gives:
All configurations were evaluated on the same frozen, balanced 34,400-image list, with a fixed threshold of 0.5 and equal weighting across 19 sources. Differences are percentage points, computed before rounding.
SCPP changes the primary prediction and therefore also changes the primary uncertainty used to weight ISOR's correction. ISOR then uses the softly attenuated feature view to refine the detached primary logits. This provides a concrete interaction between the two stages: SCPP affects both the prediction being refined and the strength of the subsequent correction.
Adding SCPP to ISOR improves mAcc/mAP by 1.60/0.53 points on the fixed list and 1.59/0.47 points on the submitted subset, using the same trained checkpoints across both evaluations. These results support SCPP's contribution within the integrated UFD model, despite its weaker standalone performance. They do not by themselves establish why SCPP alone underperforms, so we will avoid attributing that behavior to an unverified mechanism or implying uniform complementarity across protocols.
3. Auxiliary objectives and hyperparameters. The range term directly supervises the Basis MLP by constraining projected energy. The conditional-logit and correction penalties regularize refinement outputs; the directional objective supervises the correction direction; and the preservation term discourages changes to confident primary predictions. Appendix A.5 and Table 8 report the module settings and activation schedules, while Appendix B.1 provides task-specific training details.
These objectives define the intended constraints, but the current module-level ablations do not separately quantify each loss's contribution. We will distinguish their design rationale from the empirical evidence and clarify the gradient pathways. The module settings are shared across Face and UFD rather than separately configured for individual target datasets; this does not, by itself, establish their optimality.
4. Consistent reporting. We will standardize AUC, AP, accuracy, and EER as percentages throughout the tables and text, and report absolute differences in percentage points. Aggregate values will be computed from unrounded measurements before display.