- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This research focuses on improved design of fake image detectors. The primary argument is that real image distribution is much more varied than that of fake images, and hence it should be treated as an outlier detection problem. More specifically, the fake images should be considered in-distribution and the real images are considered out of distribution. The authors demonstrate that the training error gets amplified on the test distribution as a function of how misaligned the training and test distributions are. So the idea is to learn only the invariant features, for fake image detection, and provided that it captures those invariant features, the train test mismatch will be minimized and with the invariant features a out of distribution detector can be built by treating the real images as out of distribution. For the learning of these invariant features, the authors use VICReg-based info bottleneck, and use OOD detection techniques such as Deep SVDD and Energy-based techniques. They benchmark on modern Image generators and compare against prominent baselines showing improvements in accuracy/AP.
Critical strengths
- The core philosophy of treating the fake images as the in-distribution class and real images as the out of distribution class is logical and resonates with me as opposed to methods which attempt to treat the real images as the in-distribution class.
Critical weaknesses
- The paper lacks ablations regarding the OOD and the Info Bottleneck design choices. For instance, what if a classifier were just trained on the output of IB features instead of training an OOD technique. The paper also lacks what happens if the IB-specific self-supervised loss was removed and instead those augmented images are also just used as training data along with the OOD objective. This will further motivate the need for both of those design choices (although the OOD one makes sense to me intuitively). I request the authors to perform a compute equalized experiment in this case (same number of iterations batch size etc and please report these details as well for all these experiments since they are critical)
- If the model learns only invariant features (as claimed), and if the real images mainly differ due to nuisance features (lines 240-242), then there I am unable to understand why the OOD formulation still matters. Given that the paper actually claims that lines 987-990 explicitly mention that train and OOD real distributions will be close to each other. In this case, if the nuisance-based differences between them are ignored then even a simple classifier should suffice. I request the authors for more clarity on this regard.
- The "Real as ID" baseline (Cai et al) as cited by the authors. I would be interested in learning how this experiment is conducted. Since the appendix b.3 referenced by the authors does not contain any information on how Cai et al method is applied for their setting.
- To me there seems to be a substantial disconnect between theory presented in the first 5 pages and the design choices adopted later on. To the best of my understanding, the theory essentially suggests that if you get rid of spurious features, and only capture invariant, predictive features, the method is more likely to generalize better which I find to be very straightforward and not offering a lot of predictive value. Building on this, Information Bottleneck is predicted as a means to do this, but it is not clear how VICReg/other self-supervised learning is the only way to achieve this (echoing my concerns raised in Weakness 1). I wish to hear the authors thoughts on the connection between their design and the theory as well as the novelty in the information bottleneck viewpoint which has not been presented in prior works such as [1].
- I would really like to see the authors test the robustness of the detector to post-processing techniques such as JPEG, resizing, WEBP, additive noise, color jitter etc and provide a detailed analysis since robustness to these techniques are very important in practice.
References
- Shwartz-Ziv, R., & Tishby, N. (2017). Opening the black box of deep neural networks via information. arXiv preprint arXiv:1703.00810.
Questions for authors
Please refer to weaknesses.