- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper investigates the computational cost and performance of fixed 2-qubit quantum feature maps on reinforcement learning experiments, mostly Gymnasium MuJoCo’s Reacher-v5, against a classical feature map and an SB3 PPO reference. The main experiment does not statistically prove a performance advantage, and the conclusion on non-inferiority is dependent on the uncertainty calculation method (positive result with bootsrap but not with student-t). Meanwhile, its training time and action latency are approximately 4 times greater than those of the classical counterpart. The authors acknowledge the limits of these results throughout and are honest with the scope.
Critical strengths
Here are the strong points I see about this paper:
- The paper is openly honest about its limited success, statistical uncertainty, and negative results.
- The use of binomial noise on the classical features to investigate finite-shot effects is appropriate.
- The reporting of circuit calls, number of shots, training time and latency provides useful context elements.
Critical weaknesses
Here are the weaknesses I would like to highlight to the authors to justify my recommendation:
-
Limited scientific value: The main experiments only produce a narrow negative result for a fixed arbitrary quantum feature map. The paper doesn’t discuss why it fails to show a benefit or what conclusions can be taken from these results in general. The paper reads like a technical report of a Reacher-v5 experiment with a quantum component.
-
Missing ablation: The 2-qubit circuit can be reproduced with an exact equivalent classical representation, but there is no benchmark for it. Without this ablation, the cost study mostly characterises the simulator implementation and we cannot infer how much of the cost is attributed to the quantum part.
-
Difficult readability: The labels “v9”, “V9”, “v11”, “v15” are repeatedly used without being properly defined until section 5, making it difficult to track architectures, protocols and status of each results. “Q1” is defined first in the abstract and then used in the main text, which is highly inelegant. The prose throughout the text is unnecessarily dense.
-
Weak architectural justifications: The paper doesn’t explain why the authors chose padding 10 features to 32 values and compressing them to 2 angular features. Such choices feel arbitrary.
-
Limited reproducibility: The authors don’t show any explicit intention to make the experiments reproducible after publication. They just mention the reviews cannot access the raw experiments archives in the reproducibility statement.
Questions for authors
- How does performance and cost compare to an exact equivalent classical implementation of the quantum feature pipeline?
- What motivates the architectural choices such as the 32-dimensional padding? Please answer exhaustively.
- How is the choice of 1cm non-inferiority margin justified?
- Have you tried with more qubits? Generally, what would be the impact on the cost for a n-qubit as a function of n?