- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes FS-CTAA, a per-sample conditional affine adaptation method for improving AI-generated image detection under distribution shifts. The authors introduce a correction granularity framework and apply sample-specific channel-wise scaling and bias to frozen visual features without test-time gradient updates. Experiments across four backbones and 16 target subsets demonstrate AUROC improvements of 1.67–3.49 percentage points, with per-sample correction outperforming shared affine adaptation.
Critical strengths
S1. Carefully designed controls. The comparison between shared and sample-conditioned correction is supported by parameter matching in both directions, a post-hoc shared variant with identical weights, three training seeds, and an inference-only substitution of the source mean for the target mean. Reporting AUROC alongside balanced accuracy throughout most tables also separates ranking gains from operating-point effects, which is good evaluation practice for this problem.
S2. A lightweight, practical plug-in. FS-CTAA requires no target labels and no test-time gradients, and it adds roughly 0.04 ms per sample. It improves collection-averaged AUROC on all four backbones and all three seeds, which makes it easy to attach to existing frozen detectors.
Critical weaknesses
W1. The ranking gain is largely attributable to a source-trained nonlinear re-scorer rather than to target-conditioned adaptation. With a frozen linear head, the corrected score equals the original score plus a learned nonlinear function of the feature and the two means. Comparing the shared and per-sample levels is therefore largely a comparison between a target-specific linear head and a nonlinear classifier. The paper’s own ablation makes this concrete. In the “w/o target-mean input” variant, the target enters only through the rank-invariant anchor, so by Proposition 1 its ranking is independent of the target. Yet it retains +0.0192 and +0.0168 AUROC on PE-CLIP and SigLIP2, which is 55–58% of the full gain. The source-mean substitution in Table 28 shows that the trained model relies on µ_t, not that target information is required to obtain the gain. The anchor term also cancels both in AUROC and under the mean-score threshold, so it has no direct effect at inference. The architecture closely resembles context-conditioned approaches such as ARM-CML (Zhang et al., 2021), which is not cited, and the rank-invariance criterion is a standard property of rank statistics.
W2. Augmentation and capacity are confounded with adaptation. The modulator is trained with compression, resizing, spectral, and noise episodes and a classification loss, whereas the reference probe is trained for two epochs without augmentation. The post-processing evaluation in Fig. 4 therefore tests transformations covered by the training episodes against an unaugmented baseline. The source-side controls in Table 29 report only balanced accuracy at an unstated threshold and omit AUROC, contrary to the paper’s own argument that accuracy conflates ranking with the operating point. The most direct control, an augmented MLP head of matched capacity without target context, is missing. The adapted baselines are also weakened forms; TENT, for example, is reduced to a scalar logit offset that performs below the probe. A frozen-model, gradient-free output correction such as LAME (Boudiaf et al., 2022) is not compared.
W3. The gains are concentrated, and the transductive evaluation is favorable. On PE-CLIP, the overall gain of +0.0349 comes almost entirely from Mirage (+0.1068), while GenImage and ITW change by −0.0016 and −0.0004. Weighting all 16 subsets equally reduces the gains to 1.2–2.6 points. The main protocol relies on benchmark-defined, class-balanced subsets that each contain a single generator. The boundary-free stream is evaluated on only two backbones, and the label-free threshold offers no control over the false-positive rate, which matters for forensic use. The bootstrap intervals reflect only test-sample variation at one seed, whereas the seed-to-seed standard deviations are larger than their half-widths.
Questions for authors
Q1. Could the authors compare FS-CTAA against a parameter-matched classifier that takes the concatenation of the sample feature and the target mean as input, in the spirit of ARM-CML, trained with the same episodes and objective? It would also help to include an augmented MLP head of matched capacity that receives no target context. Reporting AUROC for both would show whether the feature-wise affine form and the target context contribute beyond nonlinear rescoring with augmentation. This is the question most likely to change my assessment.
Q2. In the “w/o target-mean input” variant, the target enters only through the anchor, so its ranking is independent of the target. How do the authors reconcile its +0.0192 AUROC gain with the claim that the ranking improvement stems from target-conditioned adaptation? Relatedly, why does the unconditional adapter, which also lacks target-dependent information, reach only +0.0039, and were the two variants tuned with the same effort?
Q3. Could the authors report AUROC for the augmented linear head and the matched MLP in Table 29, state the threshold used for their balanced accuracy, and add the augmented probe to the post-processing evaluation in Fig. 4? This would show how much of the robustness gain survives once the baseline receives the same augmentations.
Q4. In the composition audit, the mean-score threshold at π = 0.8 should move by about 30% of the class-mean score gap relative to the balanced case, yet balanced accuracy changes by only 0.28 points. Could the authors report the threshold values and class-wise true-positive and true-negative rates at each ratio? In the mixed-stream experiment, a fully shuffled stream carries no subset information, so it is unclear why the EMA context outperforms the globally pooled context. Does the EMA include the current image, and how is the stream ordered?
Q5. Could the authors extend the unknown-boundary stream evaluation to all four backbones and report true-positive rates at fixed low false-positive rates? Since the label-free threshold provides no control over the false-positive rate, such operating points would better reflect forensic deployment.
5 comments
Part 2. Q2 and W1. The "w/o target-mean input" variant, the anchor and the unconditional adapter
At inference this variant ranks images independently of the target, and its gain shows that a source-trained per-sample mapping repairs part of the ordering. In the tested variants, recovering the full gain also requires target input.
Table R3-4. Gain over the probe on SigLIP2 / PE-CLIP for each variant.
| Variant | Target-dependent ranking at inference | Gain |
|---|---|---|
| Unconditional adapter | No | +0.34 / +0.39 |
| w/o target context | No | +0.51 / +0.68 |
| w/o target-mean input | No | +1.68 / +1.92 |
| w/o mean anchor | Yes | +2.02 / +2.30 |
| FS-CTAA | Yes | +2.88 / +3.49 |
Feeding μt adds a further 1.20 / 1.57 points with the anchor and 1.51 / 1.62 without it, showing a consistent benefit across anchor choices. These compare separately retrained models, not an additive decomposition. The w/o target-mean input variant retains the source reference and anchor; the unconditional adapter removes both means and the anchor. The two anchor-free variants without target input retain less than one fifth of the full gain. This supports a training role for the anchor, which aligns each shifted episode's batch mean to its clean source mean. At inference with a fixed context, the shared anchor translation cancels between score and threshold under Eq. 8, as the reviewer notes; its direct operating-point effect applies to a source-fixed threshold.
Table R3-5 summarizes the inference-time swap to all four backbones.
Table R3-5. Gain over the probe over three training seeds, with μt or μs at inference.
| Context at inference | SigLIP2 | PE-CLIP | MetaCLIP | DINOv2 |
|---|---|---|---|---|
| Target mean μt | +3.0 | +3.5 | +2.2 | +2.2 |
| Source mean μs | +0.4 | +0.6 | +0.3 | +0.2 |
The two tests answer complementary questions. Inference-only substitution tests what the trained model relies on; retraining without target input tests how much gain can be obtained without it. Retraining recovers part of the gain, but target input adds 1.2 to 1.6 points with or without the anchor. Together, these results support contributions from both the source-trained per-sample mapping and target conditioning in the tested variants. All variants share one 12-candidate search budget and, within each backbone and seed, the same episodes, source split, training steps and sample counts.
Part 3. Q3 and W2. Augmentation, capacity and adaptation baselines
Thresholds and AUROC of the augmentation and capacity control. The probe, Aug. linear and Matched MLP use a threshold selected on source validation and then fixed, the same rule as the probe in our main results. MLP + FS-CTAA places a separately trained FS-CTAA modulator on the frozen Matched MLP and uses the label-free rule of Eq. 8. Table R3-6 adds the threshold-free AUROC that the reviewer requested.
Table R3-6. AUROC in percent over three training seeds. The frozen probe is common to all seeds.
| Head | SigLIP2 | PE-CLIP | MetaCLIP | DINOv2 | Mean gain |
|---|---|---|---|---|---|
| Frozen probe | 91.49 | 89.00 | 79.68 | 70.02 | |
| Aug. linear | 90.95 | 91.34 | 78.45 | 70.57 | +0.28 |
| Matched MLP | 91.53 | 89.03 | 79.74 | 69.99 | +0.03 |
| MLP + FS-CTAA | 94.09 | 92.02 | 81.27 | 71.29 | +2.12 |
Neither source-side change helps consistently. Augmentation moves AUROC of the linear head in both directions, from +2.34 on PE-CLIP to −1.23 on MetaCLIP, and added capacity leaves it within 0.06. Placed on the same Matched MLP, FS-CTAA raises AUROC on every backbone by 1.3 to 3.0 points, so its benefit persists after source-head capacity is increased.
Augmented baselines under the Figure 4 conditions. We evaluate the augmented heads and Context MLP on the same images and 17 conditions at source-fixed operating points. Table S5 of the revised PDF reports their mean balanced accuracy.
Table R3-7. Mean balanced accuracy over the 17 post-processing conditions of Figure 4 on PE-CLIP.
| Manifest | Aug. linear | Aug. MLP | Context MLP | FS-CTAA |
|---|---|---|---|---|
| GenImage | 81.65 | 83.43 | 89.77 | 92.18 |
| Chameleon | 74.93 | 90.78 | 74.28 | 92.34 |
With the same augmentation families and source-fixed operating points, FS-CTAA remains best on both manifests and is the only method strong on both, since Aug. MLP falls behind on GenImage and Context MLP on Chameleon. The robustness of FS-CTAA is therefore not a by-product of training on the evaluated transformations.
Adaptation baselines. Our diagnostic suite already contains TENT with the LayerNorm affine parameters updated by gradient. We add two further baselines. TENT-LN restores the source weights and resets the optimizer at the start of every subset and evaluation order, and takes one entropy-minimization step per batch of 128 images. LAME uses the official optimization code with a two-class probability interface and online batches of 128.
Table R3-8. Adaptation baselines on PE-CLIP at the main checkpoint.
| Method | Test-time gradients | AUROC |
|---|---|---|
| Frozen probe | No | 89.00 |
| TENT, LayerNorm affine | Yes | 88.16 |
| TENT-LN, reset per subset and order | Yes | 68.14 |
| LAME | No | 52.11 |
| FS-CTAA | No | 92.49 |
TENT with LayerNorm updates stays below the probe on all four backbones, by 0.48 to 1.27 points. Despite the resets, TENT-LN collapses within subsets. On all four Mirage subsets and all five orders, the last tenth of batches predicts a single class, with mean predictive entropy below 7e-6 nats. This is consistent with the collapse risk of online entropy minimization discussed by Niu et al. 2023, so we keep the stronger TENT row as the main reference. LAME yields saturated probabilities with many tied scores. FS-CTAA needs no target-time optimization. Table 6 reports 0.0408 ms per image for the PE-CLIP correction module, excluding the encoder and context estimation. The revised PDF reports these tables in the appendix and cites LAME.
We thank the reviewer for the detailed and constructive review. Our reply has four parts. Part 1 answers Q1, Part 2 answers Q2, Part 3 answers Q3 and W2, and Part 4 answers Q4, Q5 and W3. Points of W1 are addressed in Parts 1 and 2. Rebuttal tables are labeled R3-x, and values are AUROC in percent unless stated otherwise. Tables R3-1, R3-2, R3-5, R3-6 and R3-12 average three training seeds, and the other tables use the main checkpoint.
Part 1. Q1 and W1. Context-conditioned and augmented nonlinear heads
We ran the requested controls over three training seeds. Parameter matching applies to the nonlinear Matched MLP, Aug. MLP and Context MLP, against the corresponding FS-CTAA modulator; the linear heads are reference baselines. Matched MLP uses clean source features. Aug. linear, Aug. MLP and Context MLP use the four forensic-shift families, as does FS-CTAA. The parameter budget, forensic-shift augmentation families, and classification supervision are matched, with residual penalties defined in their respective output spaces. Context MLP is an ARM-CML style classifier: it maps [z, μt] through one hidden layer to two logits, with a score residual relative to the anchor-corrected frozen-head score.
Table R3-1. AUROC of source-head controls and FS-CTAA, with mean gain over the probe.
Table R3-2. Pairwise AUROC differences between separately trained models in Table R3-1.
Augmented nonlinear rescoring explains part of the gain, but three observations show that it is insufficient to explain the full result. First, Matched MLP stays within 0.06 points of the probe on every backbone, so additional nonlinear capacity alone does not reproduce the improvement. Second, Aug. MLP helps on PE-CLIP and DINOv2 but not consistently across backbones; its mean gain is 0.69 points versus 2.71 for FS-CTAA. Third, Context MLP already combines nonlinear scoring, forensic-shift training and target-mean input, yet FS-CTAA exceeds it on every backbone by 0.59 to 2.05 points, averaging 1.56. Thus, access to the target mean through a generic classifier does not reproduce the benefit of using it with the sample feature to predict a feature-wise correction before the frozen head. These controls support the additional value of the FS-CTAA parameterization over the tested alternatives. The differences compare separately trained models, not additive contributions of individual ingredients. Part 2 further distinguishes dependence on target context from the gain obtainable after retraining without it.
Table R3-3 adds a control that keeps every trained weight of FS-CTAA. Shared FS-CTAA averages the predicted scale and offset within each subset, so only the per-sample variation is removed.
Table R3-3. Same trained weights at the main checkpoint, per-sample versus subset-averaged correction, gain over the probe.
Most of the gain disappears with identical weights, so the gain is not a matter of parameter count and requires the per-sample variation of the correction. Because averaging also makes the score a shared affine function of z again, this control alone does not separate per-sample correction from nonlinear scoring, which is the role of Tables R3-1 and R3-2. The revised PDF reports Table R3-1 as Table S1 in Section 4.4 and Table R3-2 as Table S4 in Appendix A.20, and cites ARM-CML. Rank invariance is classical for scores, and we use its extension to feature-level corrections to separate operating-point effects from ranking changes.