- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces GeoCue, a detector that derives three image-level responses from monocular geometry predictions: disagreement between surface normals inferred from a predicted 3D point map and directly predicted normals, and the deviations of predicted depth and 3D points from those of a frozen reference geometry model. A trainable geometry predictor is optimized with margin-based objectives that encourage real-image responses to remain consistent with the reference while pushing AI-generated-image responses beyond specified margins. A linear classifier combines the three responses. The model is trained on 8,000 images and evaluated under cross-generator shifts, in-the-wild settings, and repeated resizing and JPEG/WebP re-encoding.
Critical strengths
-
Interpretable and testable geometric responses. The proposed cues are explicitly defined, and the paper includes useful controls using the same MoGe-2 backbone, including a direct CLS-based classification alternative. This helps establish the empirical value of the geometric response formulation.
-
Relevant robustness evaluation. The experiments model repeated online redistribution through several cumulative resizing and re-encoding sequences. Testing both detection accuracy and the stability of geometric responses under these transformations addresses an important practical limitation of methods based primarily on low-level image artifacts.
Critical weaknesses
-
The interpretation of learned responses as intrinsic physical inconsistency remains insufficiently validated. The frozen-predictor observations in Figure 2 provide preliminary evidence that geometric predictions can differ between real and AI-generated images. However, the final training objectives explicitly encourage fake-image responses to diverge from the reference predictor. Therefore, larger deviations after training do not independently establish that the input image violates physical geometry; they may also reflect the learned discriminative objective, the geometry estimator's domain bias, or prediction errors. This distinction becomes especially relevant outside natural photography. Human-created illustrations can deliberately violate photographic perspective, while AI-generated images may depict coherent geometry. The authors should clarify whether their claims are restricted to photographic content and, if broader applicability is intended, evaluate style-matched human-created and AI-generated artwork. A non-geometric reference-versus-adapted-model control would also help establish how much of the gain is specifically attributable to geometry.
-
Training-source confounding and substantial class-wise failures in some subsets. The paper uses only 8,000 training images, but these are drawn from ten comparatively recent generators, whereas the external baselines use different training sources and, often, older generator families (Table 7). This makes it difficult to attribute the cross-generator advantage specifically to the geometric method or to superior sample efficiency. Although the paper includes same-backbone internal comparisons, a stronger same-training-data detector baseline would improve the external comparison. Furthermore, the claim of balanced performance needs qualification: Table 10 reports only 10.3% real-image accuracy, versus 100% fake-image accuracy, on the StarGAN subset; Table 9 reports 68.8% real-image accuracy on Chameleon. These correspond to substantial false-positive rates at the paper's fixed 0.5 threshold. Strong mean AUC does not eliminate the need to characterize such operating-point failures.
Questions for authors
- Is GeoCue intended specifically for natural photographs, or also for illustrations, paintings, and other non-photographic content? If the latter, can the authors evaluate style-matched human-created and AI-generated artworks and report false-positive rates on the human-created subset? Can they compare against a non-geometric teacher–student or reference-deviation control to isolate the role of geometry?
- Can the authors retrain a strong conventional detector using the same 8,000 training images and a comparable model-selection protocol? Appendix A states that the training set does not overlap with the evaluation benchmarks; what checks were performed for exact and near-duplicate images or shared source content?
- How do the authors explain the very low real-image accuracy for StarGAN and the relatively high false-positive rate on Chameleon? The paper already uses a fixed 0.5 threshold, but could the authors additionally report threshold sensitivity and true-positive rates at low, validation-set-defined false-positive rates? Please also give the numerical values of the six loss weights in Eqs. (3)–(4) and explain precisely how invalid geometry pixels are excluded.
I would reconsider my assessment if these questions are addressed convincingly.
4 comments
Response to Reviewer kSqE
4. Analysis of GAN Failure Cases.
-
Experimental Setup. To investigate the low real-image accuracy observed on StarGAN, we analyzed the differences in median responses between real and generated images for three geometric cues (, , and ). We used the original GeoCue model without additional training or threshold adjustment and compared these differences with those across the full AIGCDetectBench.
-
Results (Appendix E). On StarGAN, the response differences are approximately 0, 0.283, and 0.090, respectively, substantially smaller than 0.807, 1.274, and 0.457 across AIGCDetectBench. These findings are consistent with StarGAN's generation process, which modifies facial attributes such as hair color and age while largely preserving facial structure. This suggests that geometric cues may become less discriminative when generated images exhibit limited changes in geometric structure.
5. Threshold Sensitivity and False-Positive Reduction.
-
Experimental Setup. To examine the effect of threshold selection on false positives and detection performance, we calibrated a single threshold to a target FPR of 1% using a separate validation set, without retraining GeoCue. We then applied this threshold uniformly across three benchmarks and compared it with the default threshold of 0.5.
-
Results (Appendix D, Table 15). The calibrated threshold reduces FPR and narrows the gap between real-image and AI-generated-image accuracy across all three benchmarks. Notably, on LOKI, FPR decreases from 34.3% to 27.3%, while the class-wise accuracy gap narrows from 11.9 to 2.8 percentage points. Although this adjustment also leads to some reduction in TPR, these results demonstrate that validation-based threshold calibration can reduce false positives and improve class-wise balance without additional training.
6. Loss Weights and Valid-Pixel Masking.
-
Loss Weights (Sec. 3.4). The six loss weights in Eqs. (3)–(4) are set to for real images and for AI-generated images.
-
Valid-Pixel Masking. We retain only pixels where the frozen reference predictor's mask confidence exceeds 0.5 and the depth, normal, and 3D-point predictions from both the reference and cue predictors are finite (neither NaN nor Inf). Invalid pixels are excluded from geometric response computation, and the responses are averaged over valid pixels only. For scale normalization, we use the median of positive reference depth values among valid pixels.
We hope these clarifications address your concerns, and we are glad to run any further tests you would find useful. If your questions are addressed convincingly, we would be grateful if you would consider it in your final assessment.
Best, The Authors
Thank you for your response; after careful consideration, I have decided to maintain my original rating.
Response to Reviewer kSqE
Dear Reviewer kSqE,
We sincerely thank you for recognizing the interpretability of GeoCue's geometric responses and the practical relevance of our evaluation under repeated online dissemination. We also appreciate your detailed and constructive feedback.
In our previous response, we addressed your concerns through additional experiments and clarifications, including a non-geometric teacher–student comparison, comparisons with existing detectors trained on matched data, an analysis of the StarGAN failure case, threshold calibration, and implementation details.
1. Scope of Applicability.
GeoCue is designed to distinguish AI-generated images from natural photographs of real 3D scenes. Accordingly, distinguishing human-created artwork from AI-generated artwork in non-photographic content, such as illustrations and paintings, is beyond the scope of this study. We have explicitly clarified this scope in Appendix E (Scope of Applicability). To further communicate the intended scope of our work, we propose revising the paper title as follows: Beyond 2D Artifacts: Geometric Cues for Distinguishing Natural Photographs from AI-Generated Images
2. Limitations on Attribute-Level Manipulation.
Separately, even within natural-photograph-based generation and editing, geometric cues alone may provide limited discriminative power when certain attributes are modified while the overall facial geometry is largely preserved, as in StarGAN, which modifies attributes such as hair color and age.
In this regard, Wang et al. (2024), in their DEEPFAKER study, evaluated multiple existing detectors on various attribute-editing methods, including StarGAN, AttGAN, and HiSD. Their results showed that detection performance varied across manipulation types even for the same detector, with several detectors exhibiting limited generalization across these editing methods.
Furthermore, Sarkar et al. (CVPR 2024) exploit scene-level geometric cues, including perspective structure, straight-line geometry, and object–shadow relationships, to detect geometric inconsistencies in AI-generated images. When such geometric relationships are preserved under localized attribute modifications, these cues alone may provide limited discriminative evidence.
Furthermore, Zhang et al. (2026) explored complementary cues such as facial dynamics, beyond static visual features, for fine-grained facial manipulation detection in videos. Together, these studies suggest that the effectiveness of detection cues can vary depending on the generative models and manipulation types.
3. Effectiveness and Robustness of GeoCue.
Despite these limitations, GeoCue demonstrates competitive performance across diverse generative models and real-world settings within the intended scope of natural-photograph-based detection.
Specifically, GeoCue achieves a mean AUC of 89.3% across 16 generators in AIGCDetectBench and 87.6% across 10 generators in LSUN-Bedroom. On the in-the-wild benchmarks, GeoCue achieves AUCs of 88.2%, 81.9%, and 94.3% on Chameleon, LOKI, and WildRF, respectively, yielding the highest mean AUC of 88.1% across the three benchmarks.
Moreover, under three online dissemination settings involving repeated resizing and JPEG/WebP re-encoding, GeoCue maintains more stable performance than many existing detectors. These results support the ability of GeoCue's compact and interpretable geometric cues to generalize across diverse datasets and provide relative robustness under practical online sharing conditions.
4. Future Directions.
An important direction for future work is to complement geometric cues with attribute-aware visual cues that capture localized appearance changes arising from fine-grained attribute manipulations, particularly when the underlying geometric structure remains unchanged. Integrating these complementary cues with GeoCue's geometric cues may help improve its generalization to diverse generative models and fine-grained manipulation types.
We hope that these additional clarifications and revisions help address your concerns. If there are any aspects that remain insufficiently addressed or require further validation, we would greatly appreciate it if you could let us know specifically. We welcome any further comments or suggestions and would be glad to provide additional clarifications or analyses to further strengthen our work.
Thank you again for your careful evaluation and constructive feedback.
Best,
The Authors
Response to Reviewer kSqE
Dear Reviewer kSqE,
We sincerely thank you for recognizing the interpretability of GeoCue's geometric responses and the relevance of our evaluation under repeated online dissemination. We have conducted additional controlled experiments and analyses to address your concerns regarding the role of geometric cues, training-data fairness, and class-wise detection failures, while clarifying the study scope and implementation details.
1. Scope of the Study.
2. Non-Geometric Reference-Deviation Control.
Experimental Setup. To examine whether GeoCue's performance gains can be explained solely by generic teacher–student feature differences, we introduced a non-geometric feature-deviation baseline. Using the same MoGe-2 backbone, LoRA configuration, and 8K training set, this baseline employs the cosine distance between encoder features from the frozen teacher and LoRA-adapted student as the detection signal, rather than deviations between geometric predictions.
Results (Appendix D, Table 16). GeoCue achieves a mean AUC of 88.3% across five benchmarks, outperforming the feature-deviation baseline (74.3%) by 14.0 percentage points. Its consistently higher AUC across all five benchmarks indicates that generic teacher–student feature differences alone cannot fully explain GeoCue's performance, supporting the effectiveness of explicit geometric responses as detection cues.
3. Controlled Comparison with Matched Training Data.
Experimental Setup. To control for differences in training data, we retrained UnivFD, C2P-CLIP, and AIDE on the same 8,000 AIGI-Holmes images used to train GeoCue. For a fair comparison under matched training data, each method was initialized from its pretrained backbone rather than its publicly released detector checkpoint, while following its original training procedure.
Training–Evaluation Overlap Check. We used separate datasets and generators for training and evaluation, and further examined potential image overlap beyond differences in dataset names. In particular, to prevent overlap between AIGI-Holmes and AIGCDetectBench, we cross-checked the real images in AIGCDetectBench against the original image IDs from COCO train2017 and val2017. Images sharing the same COCO source IDs were excluded from the training candidates, and the final 8K training set was constructed while maintaining balanced real/fake samples across generators. We also examined the data sources and composition of LSUN-Bedroom, Chameleon, LOKI, and WildRF to check the separation between training and evaluation data.
Results (Table 4). GeoCue achieves higher AUCs than the retrained baselines on LSUN-Bedroom (87.6 vs. 69.7), Chameleon (88.2 vs. 85.9), LOKI (81.9 vs. 70.7), and WildRF (94.3 vs. 90.0), demonstrating strong overall detection performance. Furthermore, its R.Acc./F.Acc. results on Chameleon (68.8/90.6), LOKI (65.7/77.6), WildRF (83.8/91.3), and AIGCDetectBench (77.3/89.3) demonstrate balanced performance across real and AI-generated images. These results show that GeoCue maintains strong generalization under matched training data, indicating that its gains cannot be explained solely by differences in training-set size or generator composition and supporting the effectiveness of geometric cues.