- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes another quantum-inspired parameter-efficient fine-tuning method, using generator variational quantum circuit. Several benchmark showed benefit over related work.
Critical strengths
This paper extends the related work such as Q-PEFT and QPA, focusing on computational efficiency. On several benchmark, the proposed method outperforms the prior methods. Parameter efficiency and latency evaluations show benefit over related works. Using generative VQC without embedding input signals is novel in the field.
Critical weaknesses
Table 3 reports results after just five optimization steps with batch size 2. Most models show negligible improvements or even worse perplexity than the pretrained baseline. No evidence that TR-HOG is necessary, compared to other generative model: classical TT-only generator, a direct low-rank hypernetwork, and the same mapping network without quantum-inspired transformations. The claimed mitigation of barren plateaus is not theoretically established. The reported variances of approximately to are themselves extremely small. The claimed complexity describes TR operations, but the full parameter generator must produce measurement probabilities and materialize all adapter weights. The main comparison uses rank-4 LoRA, which has substantially more trainable parameters than Quan-CEFT. There is no parameter-budget-matched comparison with lower-rank LoRA or other ultra-compact classical PEFT methods such as VeRA, KronA, and LoRETTA, despite their discussion in Related Work. All main quantitative experiments use WikiText-2 causal language modeling. There are no downstream evaluations of instruction following, classification, reasoning, or domain-specific adaptation.
Questions for authors
Appendix A.5 states that the main benchmarks use exact statevector simulation rather than the proposed Tensor Ring simulator. Could the authors clarify which implementation was used for the reported training latency and memory measurements? Table 3 evaluates only five optimization steps, and several adapted models exhibit worse perplexity than their pretrained baselines. How do the authors justify drawing conclusions about fine-tuning effectiveness from such limited optimization? Can they report convergence curves and comparisons under longer or matched wall-clock training budgets? What is the specific contribution of the Hamming-weight-preserving circuit relative to the classical TR and TTN mapping networks? Can the authors provide ablations replacing the quantum-inspired generator with a purely classical tensor-network generator of comparable parameter count and computational cost? How would Quan-CEFT compare against parameter-matched classical PEFT methods, such as lower-rank LoRA, VeRA, or tensorized adapters? Are the reported advantages attributable to the proposed architecture or simply to differences in parameter budgets? Can the authors demonstrate that gradients of the actual language-modeling loss with respect to trainable TR parameters remain well-conditioned as qubit count and circuit depth increase?