- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates encryption boundary selection for privacy-preserving transformer inference. It compares head-only homomorphic computation, encrypted representation transfer with trusted downstream execution, and deeper encrypted projection and prediction. Experiments on DistilBERT, Mistral-7B, and Qwen2.5-3B examine task performance, representation leakage, and computational latency. The authors identify representation-level encryption as a favorable operating point under their hybrid trust model.
Critical strengths
None.
Critical weaknesses
- The central methodological contribution is insufficient. The proposed Repr-HE configuration performs no homomorphic computation and relies on trusted plaintext execution. The authors' own AES-GCM baseline achieves comparable utility with lower latency. Consequently, the primary result provides limited justification for the proposed HE-based framework. Moreover, the trusted component is only simulated, leaving the practical deployment assumptions unvalidated.
- The experimental comparisons do not establish a meaningful privacy–utility–efficiency advantage. The evaluated strategies rely on different trust assumptions and protect different portions of the inference pipeline. Furthermore, the extremely poor performance of Proj-Poly-HE appears to arise from unresolved encrypted-execution or implementation issues. These results provide insufficient evidence for the proposed boundary-selection methodology.
Questions for authors
- Given that AES-GCM provides equivalent protection with better efficiency under the Repr-HE trust model, what technical advantage does the proposed framework offer over conventional encrypted representation transfer?
- Can the authors demonstrate the proposed boundary-selection methodology in a realistic deployment with explicitly defined trusted and untrusted components and comparable security guarantees?