- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SEED, a continual test-time adaptation framework for AI-generated image detection without access to target labels, generator identities, or explicit domain boundaries. SEED freezes the base detector and maintains a dynamic pool of residual experts. Dual-Space Expert Modeling (DSEM) combines base-logit shift detection for expert creation with decision-orthogonal features for expert routing. Authenticity Uncertainty Estimation (AUE) derives pseudo-labels and reliability weights from Gaussian mixture models of base logits, while Progressive Knowledge Consolidation (PKC) maintains reliability-weighted feature statistics for balanced feature replay. Experiments on four benchmarks report improvements in online and final holdout performance, including up to a 17.42-percentage-point gain in final accuracy over the frozen detector. Additional ablations examine the contributions of the proposed components and expert reuse.
Critical strengths
-
The paper addresses a practically relevant continual adaptation problem. AI-generated image detectors must accommodate evolving generators while retaining previously acquired detection capabilities. Studying this problem without target labels or explicit domain boundaries is valuable for deployment. The prediction-before-update protocol and holdouts that are disjoint from the complete adaptation stream strengthen the evaluation.
-
The framework provides a coherent integration of adaptation and retention mechanisms, supported by consistent empirical gains. Dynamic residual experts, reliability-weighted pseudo-supervision, and statistical feature replay offer a plausible approach to adapting a frozen detector without retaining historical images. SEED improves both online and final holdout performance across four benchmarks under the shared-initialization continual protocol. The component and recurring-stream ablations further support the usefulness of expert management and knowledge consolidation.
Critical weaknesses
-
The comparisons do not yet fully establish the extent of SEED’s advantage over existing adaptation methods. In Tables 1 and 2, several baselines substantially underperform Frozen, with some accuracy results approaching 50%. Although Appendix B.2 describes their architectural adaptations, the baseline hyperparameter-selection procedures and diagnostics for these large degradations remain insufficiently documented. Moreover, Table 3 retains method-specific initializations: several methods start from pretrained CLIP, whereas SEED uses a source-trained detector. Consequently, the large episodic performance gaps cannot be attributed solely to the adaptation mechanisms. Comparisons with closely related expert-based CTTA approaches, such as BECoTTA and Zhao et al. (2026), are also absent. These limitations reduce confidence in the breadth and attribution of the claimed comparative advantage.
-
The stability of expert creation under dynamically changing class proportions remains insufficiently validated. DSEM detects changes in the marginal base-logit distribution, which can change when the real/generated proportion varies even if the class-conditional distributions remain unchanged. The decision-orthogonal projection is used for routing and does not directly remove this confounding factor from the expert-creation criterion. Table S2 evaluates different fixed proportions across separate runs, rather than changing proportions within a stream. Although the framework does not require experts to correspond one-to-one with generators, it remains unclear whether prior shifts alone cause redundant expert creation, repeated adaptation warm-up, or performance degradation. This uncertainty matters for the claimed suitability for continual deployment on non-stationary streams.
Questions for authors
-
For Tables 1 and 2, could the authors clarify how baseline hyperparameters were selected, including the development data, learning rates, and update budgets? What implementation checks or diagnostics were performed to explain the substantial degradation of several methods relative to Frozen, such as predicted class proportions or adaptation trajectories?
-
For Table 3, could the authors report each method’s performance before adaptation and its corresponding adaptation gain, given the different initializations described in Appendix B.2? Where compatible, a shared-initialization comparison would help isolate the contribution of adaptation. Please also explain whether closely related expert-based CTTA methods, such as BECoTTA and Zhao et al. (2026), can be evaluated under this protocol, or identify the specific obstacles to a meaningful comparison.
-
When only the real/generated proportion changes within a stream, how does DSEM’s expert-creation mechanism behave? A controlled evaluation with a fixed generator and changing class proportions, reporting expert counts, creation events, routing behavior, and balanced accuracy, would directly address this concern. Do the existing results or additional analyses indicate whether such shifts lead to redundant experts or detection degradation?