- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a system optimization for reducing the cost of CKKS in transformer-based models. The proposed techniques are evaluated on the Llama3-8B model.
Critical strengths
- I believe this paper tries to address an important problem because being able to effectively apply CKKS to transformer models would be a kind of milestone of end-to-end privacy-preserving ML applications.
Critical weaknesses
-
I'm not sure I have fully understood the contributions, specifically to ICLR. The meat of methodology, i.e. Section 4, mostly presents something already existing, such as Cerium and fused MAC.
-
Figure 2 does not look very professional
-
The evaluation could be improved. For example, when testing prefill, only the first layer is evaluated, and we have no idea how much performance overhead for the end-to-end execution. Also, only one backbone model is being tested, i.e. Llama3-8B.
-
I also believe some important references were missing.
Questions for authors
I think this paper needs a lot of work before publication. I hope my comments in the "Critical Weaknesses" could help the authors to improve the work. I don't have more specific questions beyond my comments above.