- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work proposes a novel gradient inversion attack, which follows i) a gradient-mean guided adaptive initialization strategy, ii) block-wise gradient matching mechanism, iii) image encoding and decoding to reduce the optimization space. By adopting these techniques, it claims to improve the reconstruction stability and quality across different target images.
Critical strengths
The problem this paper studies is of significant importance in the relevant literature.
Critical weaknesses
-
Related works are not discussed well. A recent work, SPEAR [1] proposes exact gradient inversion attack for a batch of images, leveraging low-rank structure of gradients. The paper does not cite this work and compare against this.
-
Narrowing the search space by performing optimization in lower-dimensional space has been studied earlier [2]. This work should be discussed. An explicit explanation on whether the proposed image encoding, decoding mechanism performs better than this prior work should be included.
-
The intuition of using a four-step gradient matching strategy across different blocks is not clear. For example, why are the gradients only from Block 4 matched in Step I, then gradients from Blocks 3 and 4 in Step II, later half of Block 2 in Step III? An explanation given is coarse-to-fine matching procedure, but even in that case, why this specific structure of block selection is adopted is not clearly explained or motivated. Why are gradients from Block 1 not used at all? Even though an ablation study in Fig. 8 is provided showing the impact of adding Block 1 gradient matching, the underlying cause has yet to be elucidated. Whether this phenomenon is specific to a particular dataset/architecture or there lies a valid underlying reason is unclear. Similarly, the intuition of using adaptive weighting of residual layers in different blocks is unclear. For example, when the gradient is less than \beta, why do we assign a weight of 0.1 to the residual layers in Block 4? These need to be well-explained.
-
It appears that the proposed method is limited to ResNet like architectures with four blocks, as discussed throughout the paper. It is better to discuss its adaptability or potential extension to other architectures like attention layers in Transformer. Otherwise, the contribution seems much limited.
-
The improvement in reconstruction over the baseline, TLG is marginal as observed in Figs. 2, 3.
[1] Dimitrov, D.I., Baader, M., Müller, M.N., & Vechev, M.T. (2024). SPEAR: Exact Gradient Inversion of Batches in Federated Learning. Neurips 2024.
[2] Jeon, J., Kim, J., Lee, K., Oh, S., & Ok, J. (2021). Gradient Inversion with Generative Image Prior. Neurips 2021.
Questions for authors
It is stated that x’ is initialized using the gradient mean. For a batch of images, is the entire batch initialized using the gradient mean, where the gradient is derived from a batch of images? Can you elaborate this further?