- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies proper reference point specification in multi-objective bayesian optimization using expected hypervolume improvement. It propose two stage approach for this problem. In the first stage, the reference point is set iteratively per objective such that the optimization is focused on each of the objective iteratively (such as single objective optimization). In the 2nd stage, the reference point in the standard way, assuming the first stage has identified all the boundary point in the Pareto front. The paper has compared exhaustively with many different reference point specification approach and demonstrate the algorithm works empirically competitive.
Critical strengths
- The paper propose a simple but empirically competitive method for reference point specification.
- The paper is well-written and easy to follow.
Critical weaknesses
- One of the main limitation of this paper is its rather practical, although has conduct extensive empirical investigation, the method itself is less sound; Additionally, the two step transfer also introduce the hyperparametr that can make the algorithm cumbersome to tune.
- Another issue is that, different objective function may have different optimization difficulty, it is not sound by simply looping each objective with the hope that each objective can be optimized evenly well in the first stage.
Questions for authors
- Following the 2nd weakness, could the author clarify if different objective function have different optimization difficulty, does switch of reference point to preference each objective function is appropriate or maybe more appropriate approach could be deviced?
- Does the author feel the following paper [1] relevant to discuss in the paper?
[1] Zheng, R., & Wang, Z. (2024). Boundary decomposition for nadir objective vector estimation. Advances in Neural Information Processing Systems, 37, 14349-14385.