- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The work targets on reducing the communication and computational overheads during converting intermediate states between HE and MPC in secure transformer inference. The paper proposed several control protocols for GELU, Softmax and Layernorm. The paper conducted experiments on BERT-base and BERT-large to show its improvements. The motivation makes sense, but the technical and experimental details are a bit difficult to follow.
Critical strengths
The paper includes many figures to explain the technical details. The figures are nice.
The paper considers baselines from both HE-only methods and HE+MPC methods.
Critical weaknesses
-
The work only considers 3 functions in transformer and only tests the proposed methods in BERT style models. It’s unclear that whether the proposed method can be applied to other transformer models like Llama, and whether the proposed GELU control can be used in other activations like Silu.
-
The implementation details are missing. The paper doesn’t provide codebase and also doesn’t clear describe the library, HE parameters, security levels and other reproducibility details.
-
The paper misses some important related works and baselines in secure transformer inference like MOAI[1], ARION[2], PUMA[3] etc
-
The description is unclear. For example, Table 2, it doesn’t introduce what is P(x). In section 4.1, there are many notations in Figure 2 such as PR(x), QR(x), EP(), but authors don’t explain them.
[1] MOAI: Module-optimizing architecture for non-interactive secure transformer inference. ICLR 2026
[2] ARION: Attention-optimized transformer inference on encrypted data[J]. Cryptology ePrint Archive, 2025.
[3] Puma: Secure inference of llama-7b in five minutes[J]. Security and Safety, 2025, 4: 2025014.
Questions for authors
-
How to decide the parameters like K, R in the proposed method? How will them affect the efficiency and accuracy?
-
In Table 3, does the latency of SHRINK considers the communication latency? What network setting is used in this evaluation?
-
What packing methods and matrix multiplication algorithms are used in SHRINK?