- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes RAOA, a recurrent update over a latent state that alternates a "problem" step defined as an energy minimization step, with a "mixer" step that adds a weighted feedback connection to the system. The motivation is that each pass could conceptually be executed by programmable radio propagation through a reconfigurable intelligent surface (RIS) with receiver feedback, so that repeated passes provide "computational depth" without extra hardware or parameters. The framework is tested on exact discrete optimization tasks, on a simplified 9x9 grid simulation and digitally as an LLM adaptation.
Critical strengths
- The paper repeatedly states the specific contributions compared to existing literature as well as being transparent on negative results.
- Each experiment performed seems well performed and is sensible in itself (Exact optimization, Simulation of small 9x9 grid, LLM adaptation on digital 64x64 grid)
Critical weaknesses
- The paper is very difficult to read and requires substantial rewriting.
- 1.1 Many abbreviations are not introduced (HUBO/QUBO, Ancilla, QAOA, Max-Cut, 3-Sat,...), even key concepts such as "problem pass" and "mixture pass" are not clearly defined.
- 1.2 The general positioning of the paper is not clear, clearer explanations on why such a design is desired in the first place would have been much appreciated.
- 1.3 The text in the results section (5) contains no analysis of results but merely other results that are written out in numbers. The results section should contain at least some interpretation of the shown results.
- 1.4 Figures 1/2 are not helpful and contain bad lay-out (Fig 1. arrows) and (at that point in the paper) irrelevant results (Fig 2. cubic MSE, 49.3% linear,..). In fact, Figure 5 is the clearest, but unfortunately pushed to the appendix
-
The connection between theory/experiments and the radio-wave domain are somewhat unclear. Only results 5.4 actually rely on the "radio-interpretation", and from what I understand it performs quite poorly (36-40% Normalized Frobenius error: table 3)? The results on the LLM essentially ablate a single bottleneck layer (L=1, as more doesn't help), which is not so interesting as such. The interpretation through RIS/SIMs makes the paper substantially more difficult to parse and, in my opinion, the performed experiments and/or theory currently do not justify this.
-
I feel like the comparison to LoRA is a bit of a stretch, LoRA shows plenty of advantages that additional layers do not (for instance that the fine-tuned weights can simply be added to the pretrained ones thanks to linearity). Differences should be described in more detail and RAOAs existence justified more solidly.
-
This made me think a lot about other energy based frameworks, such as Hopfield Networks (Ising-like models). I felt that the connection to that particular research domain was lacking and could have been explored more, although seeing the current abundance of ML papers I believe it is natural to miss certain connections. Still I'd like to hear the authors opinion on connections between their method and Ising-like approaches.
Questions for authors
-
Related to W2: Why is 35% error good enough? Why is the connection to radio waves so essential to this work, what would change if the term is dropped from theory and experiments?
-
Related to W2: Isn't there also some additional cost (as in energy, transmission inaccuracy etc) that should be included in the framework for it to really be a physically plausible model? For the moment it seems very far from true RIS/SIMs, if the goal is really to have a physically plausible AI method as the title suggests, discussions on where limitations lie are crucial.
-
Related to W3: How does this framework relate to Hopfield Networks?
2 comments
I thank the authors for their answers to our questions. Even though the responses are meaningful, the required and announced adaptations to the manuscript are considerable. Since the manuscript seems not to have been reworked, it is difficult to evaluate whether my concerns regarding clarity and writing would be properly addressed. The answers to the other questions also remain rather vague, particularly regarding W2 and W3. Overall my original concerns remain, and for this reason, I maintain my score.
Thank you for the direct presentation and positioning criticism. We agree that important definitions and the physical/digital boundary are currently too difficult to find, and that the results section needs interpretation rather than a sequence of tables.
1. Presentation and figures. We will introduce QUBO/HUBO, ancillas, QAOA, Max-Cut, 3-SAT, the problem step, mixer step, and modeled pass depth before using them. We will redraw Fig. 1 with a clearer state-feedback path and visible separation between the programmed radio operator and digital normalization/feedback.
We will move the small cubic-MSE/delayed-product annotations out of the main operator-ladder figure, and promote a clean vector version of the more intuitive Appendix Fig. 5 concept. Each results subsection will lead with the scientific question and end with what the evidence supports and what it does not.
2. Why radio and what does the 35%-40% error mean? The physical experiment is a constrained operator-compilation study, not a claim that 35% error is intrinsically good.
The original nine-mode model had about 0.35-0.41 normalized operator error at four panels; our new 13-mode, 12-variable Max-Cut experiment reports about 0.495 problem-operator error at four panels and downstream success 0.0878 versus 0.1604 for the simpler problem-only recurrence at equal nominal propagation passes. More panels improve average approximation but individual geometries still fail.
Simulated four-panel full RAOA preserves 0.0856 success at an assumed normalized 20-dB readout SNR versus 0.0878 without noise, and four-bit feedback gives 0.0856 versus 0.0878 with unquantized feedback. These are not received-power measurements.
Significant modeled phase drift degrades success, and hypothetical phase-offset calibration can restore much of it; calibration overhead remains open.
The radio component supplies a concrete constrained substrate for reconfigurable linear operators, while all
tanh, normalization, controller updates, and feedback are digital. We will state explicitly that a measured closed-loop RF implementation and energy/link-budget accounting are future work.3. LoRA distinction. We agree that LoRA has advantages RAOA does not share: a low-rank linear weight update can often be merged into frozen weights for inference, whereas RAOA's nonlinear recurrent residual path generally cannot. Our trainable-parameter matching does not imply equal inference operations or hardware costs.
We use LoRA and MLP as reference adaptation baselines rather than claiming RAOA dominates them. Indeed the matched digital recurrent Qwen baseline is better than RAOA on WikiText in our study (NLL 2.6727 vs 2.6851), so the correct claim is feasible structured adapter transfer, not unique digital superiority.
4. Hopfield/Ising connection. RAOA shares energy-derived local-field updates with Hopfield/Ising-type networks and with unrolled optimization. It differs in its explicit finite-depth tied-control recurrence, optional cross-coordinate mixer, and proposed correspondence between the linear portions of the update and reprogrammable propagation.
Unlike standard energy-descent interpretations, the complete
tanh/mixer stage has no guaranteed monotonic decrease of the energy. Its relationship to QAOA is architectural (alternating roles), not quantum equivalence.We will make these connections explicit and, in light of our additional ablations, identify dynamic local-field recomputation rather than universal Hadamard-mixer benefit as the consistent mechanism.