- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposed a new method for solving the high-dimensional black-box optimization, by guiding the base diffusion models with either GP likelihood or UCB scores that are induced from a Gaussian process.
Critical strengths
- The paper is well written and easy to understand the core techniques
- The method is reasonable and the result is promising for several tasks including image generation with style-guided or human-preference, ligand optimization and nuclear fusion
Critical weaknesses
Overall, the core technical contribution of this paper is not novel and the experimental results are too limited.
- Omission of diffusion training : the pre-training process for the base diffusion is unclear, how would the author pre-trained this diffusion model, and how would it be adapted to the new observations in each iterations. In the Algorithm 2, the training diffusion was not mentioned at all. I assumed that the author train their diffusion only with the unlabeled dataset , but it’s not sufficient since the diffusion model could be fine-tuned with new observations from the with reweighting techniques similar to [1].
- The core technique (sub-routine B) is not novel : the UCB-guided diffusion was introduced in [2]. Basically, [2] also sample their candidates from the weighted distribution where is their base diffusion. The only notable difference is that [2] fine-tune their diffusion to sample while this paper utilized universal guidance sampling to approximate .
- The choice of universal guidance sampling is not evaluated sufficiently. To sample the weighted posterior diffusion models (e.g ), any kind of training-free guidance techniques could be applied. The author need to ablate their design choices with other TFG techniques in [3] for their candidates sampling.
- Lacking of crucial sensitivity analysis on core hyperparameters such as the guidance strength , the UCB params . These hyperparameter choices would significantly effect to the final performance of their method. Furthermore, the authors should provide additional ablation study on the choice of kernels for the Gaussian process.
- Lacking of standard baselines in high dimensional blackbox optimization such as [2],[4],[5],[6],[7]. The author did not provided neither discussion nor empirical results with these methods. Their main experiment results are not sufficient since they mostly compared with only two of their own variants in guidance sampling : fwd uni-guided and unguided. This two setting should be considered as ablation study rather than the main baseline.
- Lacking of empirical results on common tasks: how this method would perform on mujoco locomotion tasks, rover trajectory optimization or lasso bench ?
References:
[1] Diffusion Models for Black-Box Optimization
[2] Posterior Inference with Diffusion Models for High-dimensional Black-box Optimization
[3] TFG: Unified Training-Free Guidance for Diffusion Models
[4] Scalable global optimization via local bayesian optimization.
[5] Improving sample efficiency of high dimensional bayesian optimization with mcmc.
[6] High-dimensional bayesian optimization via covariance matrix adaptation strategy.
[7] Diffusion-based inverse modeling for black-box optimization.
Questions for authors
See Weakness