- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper considers a model auditing scenario where a model owner has a victim model and suspects that another model may be derived from it. The auditor only has black-box access to the suspect model and wants to determine whether it was stolen without modifying the original victim model.
The paper addresses this problem by looking at how the suspect model differs from the victim. The main observation is that stolen models tend to retain more input information but less label-related information than the victim. Based on this, the method first checks whether the suspect shows this directional information deterioration, and then compares it with a group of independently trained models to determine whether such behavior is unusual for a normally trained model.
The experiments cover multiple model architectures and stealing strategies, including fine-tuning, pruning, knowledge distillation, and model extraction. The proposed method achieves strong detection performance.
Critical strengths
-
The information deterioration phenomenon identified in this paper is interesting and insightful. Specifically, the authors observe that stolen models tend to retain more input information while preserving less label-relevant information than the victim model. This phenomenon provides a novel perspective for model auditing.
-
The proposed auditing method performs well across a wide range of model-stealing strategies. This consistent performance suggests that the proposed auditing signal has good generality across different stealing mechanisms.
Critical weaknesses
-
My main concern with this paper is that the proposed method requires querying the suspect model with the victim model’s training data. In practice, the owner of the suspect model is usually an untrusted third party, and sending private training samples to such a model could expose these data to the third party. I believe this introduces an additional privacy and security risk. It seems unreasonable to require the model owner to expose private training data in order to verify model ownership.
-
It is unclear how universal the observed information deterioration phenomenon is. Although the paper provides some theoretical analysis, it depends on several specific assumptions that may not hold for model stealing in general.
-
The evaluated model architectures are somewhat outdated. Most experiments are conducted on relatively small or classical vision models. It would strengthen the paper to evaluate whether the proposed information-bottleneck deterioration phenomenon also holds for more recent and larger vision architectures.
Questions for authors
-
Can the proposed method still achieve strong auditing performance without using the victim model’s private training data? If the method can be shown to work well with non-private or held-out data, this would substantially address my main concern, and I am willing to increase my score.
-
Can the information deterioration phenomenon also be observed in more modern architectures?