- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies semantic privacy in learned joint source-channel-encryption coding (JSCEC), and focuses on whether disentangled representations can prevent private semantic information from leaking through public latent components. The paper shows that unsupervised disentanglement cannot generally guarantee zero leakage due to non-identifiability, while weak supervision with paired observations can provide stronger guarantees under suitable assumptions. For dependent public and private factors, the paper characterizes a lower bound on unavoidable leakage. Building on these observations, this paper proposes a feature-selective JSCEC framework using disentangled representations and keyed Haar random rotations for encryption. Experiments on four disentanglement datasets investigate the relationship between representation quality, reconstruction performance, and semantic privacy.
Critical strengths
-
The paper addresses an important connection between representation learning and semantic privacy in communication systems. In particular, it highlights that disentanglement alone does not necessarily prevent private semantic information from appearing in public latent components. This is meaningful for feature-selective encryption.
-
The theoretical analysis provides a useful characterization of semantic privacy under different assumptions. In particular, Proposition 1 establishes a lower bound on unavoidable leakage when public and private factors are dependent, and characterizes conditions under which this bound can be achieved. This provides a principled perspective on the fundamental limits in semantic privacy.
-
The experiments provide some evidence connecting representation quality to semantic privacy. In particular, the substantial leakage observed on Cars3D, where disentanglement quality is poor, is consistent with the paper’s theoretical motivation.
Critical weaknesses
-
Limited theoretical novelty. The main theoretical observations appear incremental relative to existing results on unsupervised non-identifiability and weakly supervised disentanglement, both of which are acknowledged and cited by the authors. While their application to semantic privacy is meaningful, the paper does not sufficiently clarify what new theoretical insights are established beyond the existing literature.
-
Limited discussion of the theoretical assumptions in practical settings. The theoretical guarantees rely on idealized assumptions, including infinite data, exact matching of the data distribution, and specific paired-data conditions. However, the proposed system is implemented using representations learned from finite datasets. The paper provides limited discussion of how these assumptions relate to the practical setting, or how violations of these assumptions may affect semantic privacy.
-
Insufficient comparison with existing approaches. The paper proposes a feature-selective JSCEC framework but does not provide direct comparisons with existing JSCC/JSCEC methods. The authors also acknowledge this limitation in the conclusion. Without such comparisons, it is difficult to assess the practical advantages and trade-offs of the proposed framework in terms of semantic privacy, reconstruction quality, and communication efficiency.
Questions for authors
-
How do Theorems 1 and 2 extend the existing results on unsupervised non-identifiability and weakly supervised disentanglement already cited in the paper?
-
Could the authors further discuss how the idealized assumptions relate to finite-sample training, or provide empirical evidence on how relaxing these assumptions affects semantic privacy?
-
Could the authors include comparisons with existing JSCC/JSCEC approaches and extend the evaluation to additional representation models or settings?
Official Comment by Reviewer hQgn
Thank you for the clarification and the additional results. Proposition 3 helps connect the theory to the experimental setups, but it is still under the conditions of Proposition 2. My main concern remains how the guarantees and theoretical results relate to practical training when these assumptions are only approximately satisfied or even not. I therefore maintain my original score.