- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes COMPASS, a data-aware subspace adaptation framework for generalizable AI-generated image and deepfake detection. Building upon EFFORT, the method introduces an unlabeled Semantic Proxy Set to estimate activation covariance, which guides the decomposition of pretrained VFM weights into frozen principal components and trainable residual components. Experiments on cross-dataset, cross-method, joint cross-dataset-method, and cross-generator detection benchmarks demonstrate promising generalization performance. Additional ablations investigate proxy-set selection, covariance guidance, and different VFM backbones.
Critical strengths
-
Strong empirical performance across diverse evaluation settings. The method demonstrates improvements over competitive baselines, particularly under joint dataset-method shifts and cross-generator evaluation. These results suggest that the proposed calibration strategy can improve the generalization of forgery detectors.
-
Simple and parameter-efficient adaptation framework. Incorporating activation statistics into pretrained weight decomposition is an intuitive extension of existing subspace adaptation methods. The calibration requires no gradient-based optimization, and the method retains the parameter efficiency of low-rank residual adaptation.
Critical weaknesses
-
Insufficient theoretical justification The response-preservation objective in Eq. (3) naturally leads to covariance-root weighting, yet the proposed method empirically adopts the full covariance matrix without a corresponding theoretical justification. More importantly, Eqs. (8)–(10) require inverting the covariance matrix, which may be rank-deficient when estimated from a small proxy set. The paper does not clearly explain how this issue is handled or whether regularization affects the resulting decomposition. These concerns weaken the theoretical foundation and reproducibility of the central method.
-
Unclear generalization protocol and potential dependence on target-domain information. COMPASS relies on a Semantic Proxy Set sampled from the target-category distribution, whereas the compared baselines do not appear to receive equivalent target-distribution information. Although the authors state that test samples are excluded, the precise relationship between the proxy sources and evaluation domains remains unclear. Consequently, it is difficult to disentangle the benefits of covariance-guided decomposition from those of additional target-domain exposure, making the fairness of the generalization comparison uncertain.
Questions for authors
-
How is the inverse covariance matrix computed when the estimated covariance is rank-deficient? Is regularization or a pseudoinverse employed, and how sensitive are the results to this choice?
-
Can the authors clarify the exact construction of the Semantic Proxy Set for each evaluation protocol? In particular, does it contain samples from the target evaluation domains or manipulation categories? How does COMPASS perform when the proxy set is restricted to the source training distribution, and how does EFFORT perform when given equivalent target-domain information?