- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes Q-OPS, a framework for evaluating whether contextual bandits can learn when to invoke quantum computation based on its expected benefit and cost. The authors consider 3 actions: (1) decline, (2) invoke QAOA at depth 1, and (3) invoke QAOA at depth 2. The authors compare ridge-UCB, RBF, and quantum kernel representations. The experiments show that QAOA improves solution quality relative to uniform sampling. However, all three learned policies invoke quantum computation on every eligible instance and obtain negative cumulative rewards.
Critical strengths
- This paper considers whether quantum computation should be invoked based on its expected benefit and cost, which is an interesting question.
- The authors report negative results on the failures of the tested learning algorithms and acknowledge important limitations of their evaluation.
Critical weaknesses
- The technical novelty and contribution are limited. This paper does not propose new algorithms, bandit formulations, or theoretical results. The main contribution is an evaluation/audit combining existing QAOA, kernel representations, and ridge-UCB. Moreover, in the experiments, QAOA is primarily compared against uniform sampling rather than competitive baseline methods. So the technical contribution is rather limited for ICLR.
- The proposed evaluation/audit relies entirely on a synthetic environment and a manually constructed evaluation objective given in Equation (1). The paper does not justify the choice of this objective function and the coefficients (i.e., why choosing coefficients 2, 9, 600, 150, 45?) or examine whether the main findings remain valid under different objectives or environments.
- The observed learning failures are not adequately explained.
- The presentation is unnecessarily complicated and repetitive. The authors introduce many nonstandard terms and frequently use lengthy expressions with multiple hyphens, such as "reference-relative output quality" and "proxy net evidence-acquisition value", which makes the main ideas harder to follow. Many notations are used before being defined. For example, Figure 1 uses symbols such as and before their formal definitions. Equation (1) introduces numerous quantities, but they are only briefly explained in Appendix B, without precise mathematical definitions. Figure 1 is difficult to understand since it combines too many elements without explaining how they are related. It also contains numerous symbols and technical terms without sufficient explanation. Table 1 largely repeats experimental settings already described in the main text.
Questions for authors
- What motivates the particular evaluation objective in Equation (1)? How were the coefficients of its different terms determined? More importantly, are the main experimental findings robust to other objective functions or different choices of these coefficients?
- What general insights can be drawn from the negative results? The paper shows that the tested UCB policies fail to learn effective selective invocation. Could you identify whether this failure arises from insufficient contextual information, the learning algorithm, or the experimental design?