- Rating
- 4(+2)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper exposes a really interesting but conceptually niche strength in a very specific type of quantum circuit over a very specific type of classical machine learning layer.
The authors present a shallow and simple quantum circuit consisting of stacked layers a) data-reupploading, b) learned ising entanglement, and c) learned local rotations. The circuit is simultaneously proven, demonstrated, and hypothesized about, but for three slightly different statements. To the authors' credit, they are unusually explicit about where those statements do and do not overlap.
A major motivation and result is that classical transformers have a hypothetical order limitation prior to the softmax. This makes sense, and I can fully understand how someone in quantum ML could notice this, given the constant contention we muddle in between quantum circuits being linear and also highly expressive. Their method performs quite well on several tasks following this regime.
The paper has clearly stated limitations in theory and results woven together with defensible claims making for a coherent and tame set of claims.
Critical strengths
- The circuit is simple, well studied, and easily realisable. Results on simulation and real-world hardware reflect expected differences, aside from the oddly satisfying and surpising coherence of the ising gates.
- The result sits in a niche that may seem unusual on the surface, but studying the mechanisms that make the well founded classical models strong and weak, especially in terms of linearity and expressivity, is critical to clawing our way towards a better understanding of how both classical and quantum systems work. Higher Order function approximation from ising layers is exciting.
- It was buried pretty heavily, but seeing that entanglement is necessary to get this advantage is a bigger result than you present
Critical weaknesses
This paper does not seem to necessary know what it is trying to say. A lot of the text reads defensively, like it is mostly about what it is not about, which limits the novelty. I can see a world where this paper is called "Higher Order Reupploading Ising Mixer" or something, and it becomes easier to defend and justify the stronger evidence and claims buried in the paper. Though I really do understand that metaphor to classical methods may make the nuanced ideas more digestible.
Questions for authors
What really is your strongest claim, that you absolutely wanted us readers to leave the paper having understood, and where in the paper is this claim directly supported?
This commitment to "attention," is it directly necessary to present the strengths of this paradigm, and if so, why is the connection between this "attention" and entanglement presented in 5.1.c not more confidently relevant?