- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2(+1)
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper examines PALQO and QuACK, two methods that reduce quantum measurements by predicting optimized trajectories. The authors argue that the reported speedups approximately 30-fold and over 200-fold rely on gradient descent baselines using small learning rates; consequently, these results do not directly demonstrate that learned surrogate models outperform conventional optimizers with well-tuned hyperparameters.
Critical strengths
In Table 2, the authors distinguish between the costs of energy evaluation and the full parameter-shift gradient calculation, while also tallying the number of inner optimization calls. For a 20-qubit system, PALQO requires approximately 48,000 circuit evaluations to reach a target energy difference of 0.200, whereas Adam achieves this goal within about 38,000 evaluations.
Figure 4 shows that Adam outperforms the tested PALQO variants at learning rates between 0.1 and 0.5, though this trend reverses at learning rates of 0.01 or lower. The authors also acknowledge that L-BFGS fails under limited sampling, Proposition 2 is inapplicable to QuACK, and the incremental benefit of QuACK over Adam with tuned hyperparameters has not been verified.
Critical weaknesses
Both Appendix F and Table 7 state that the target energy is defined using 6,000 gradient steps with the reference optimizer; however, the reference query count in Table 3 corresponds to 25,000 steps. The authors should clarify this inconsistency.
While the authors selected specific learning rates for the added GD and Adam optimizers, they kept the surrogate model configurations and runtime durations fixed at public defaults. This supports the conclusion that "these default implementations underperform the selected standard optimizers," but it fails to adequately distinguish whether the performance gap stems from a weak reference baseline, the surrogate model configuration, the stopping criteria, or discrepancies in reproduction.
Figure 3 lacks a legend entirely; overall, the paper is very difficult to read.
Questions for authors
See weaknesses.
PALQO failed to reach the target within the fixed horizon, whereas QuACK's multipliers were calculated based only on successful seeds. Please report costs and success rates across multiple precision thresholds.
Does QuACK still yield incremental gains compared to Adam after the latter has been tuned? If this comparison is not included, the conclusions should be explicitly qualified as applying only to the small-step-size GD setting examined.