- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper suggests VIGIL framework doing imputation and forecasting by using server-hosted time-series diffusion models without prohibiting the client’s data to be exposed. Existing latent-based privacy-preserving methods have limitations that they do not preserve the relative positions between data and representation space. To address this limitation, VIGIL optimizes a latent anchor on the client side by minimizing the reconstruction error on observed entries and constructs a confidence map based on the variance of latent representations induced by changes in missing values. And then, the server uses this anthor and confidence map to adjust the latent at each reverse step on diffusion models and performs conditional generation without any training or decoder access. They achieved good performance on five multivariate time-series datasets and the effect of the confidence map was also confirmed through the ablation study.
Critical strengths
- A simple, training-free latent mask for non-local encoders. The variance-based confidence map needs only forward passes of the client’s encoder and works for any encoder.
- Empirical results. For five datasets, they achieve competitive performance in the latent space diffusion setting despite reconstruction errors.
- The writing is easy to follow.
Critical weaknesses
- Novelty comparing with the latent inpainting method. Data Guidance is a combination of normalised gradients, multiple corrections, and dynamic guidance-strength schedule for projectionless MPGD [1]. Therefore, the “(ours)” notation in Table 1 is excessive.
- The motivation of the “server” is weak. The authors stated that this method is valid for heavy computation assignments (Appendix H.4). However, if there is a risk of data leakage, wouldn't it be best to use a different method like TEE and simply perform conditional training, as shown in Table 1, to achieve the best performance?
- Asymmetry of tuning effort. VIGIL performs 200 corrections per reverse step, while Data Guidance and Spinning Decoder use 10 corrections with "limited pre-tuning." In the data space, the authors say that convergence occurs quickly, and there is no repetition count ablation.
[1] He et al., Manifold Preserving Guided Diffusion, in ICLR 2024.
Questions for authors
-
In the end, what VIGIL means is a very narrow domain. It is a situation where you cannot use TEEs, they are unreliable, and even running the client yourself is difficult for CSDI, but the autoencoder can still learn. Does such an environment really exist?
-
In diffusion models, the global structure is determined in the early stage when noise is high, and the later stage is the refinement of details. But, the schedule of the paper imposes the weakest constraints early on when the global structure is defined, and the strongest constraints at the end. Requests η(t) and K(t) ablation.
And please see the weaknesses.