- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates the intrinsic dimension of training neural quantum states (NQS) using variational Monte Carlo. Following existing approaches to measuring intrinsic dimension, the authors restrict optimization to random low-dimensional subspaces of the network parameters, using stochastic reconfiguration in the latent space.
The experiments focus on the J1–J2 Heisenberg model and the transverse-field Ising model. The main findings are that low-dimensional training can improve optimization stability, that apparent compressibility can reflect limitations of the variational ansatz rather than the complexity of the ground state, and that the measured intrinsic dimension changes across a quantum phase transition.
Critical strengths
-
Potentially useful diagnostic. Measuring intrinsic dimension could provide an inexpensive proxy for the difficulty of learning different quantum systems, particularly if it can be related to physical properties or computational scaling.
-
Interesting experimental controls. The separation between amplitude and sign learning, particularly the exact-sign comparison and the identification of the positive-cone bound, helps distinguish limitations of the ansatz from optimization difficulty.
-
Optimization stability. The reported reduction in divergence events under subspace training is encouraging. The additional experiment using a matched stochastic reconfiguration solver helps support this observation.
Critical weaknesses
-
Limited novelty. The methodology largely transfers established techniques for measuring intrinsic dimension and optimizing in random subspaces to NQS. The stochastic reconfiguration formulation follows directly from the standard pullback of the quantum geometric tensor. The main novelty is therefore in the application and empirical observations rather than in the methodology.
-
Limited scientific insight. My principal concern is that the paper does not develop a sufficiently strong hypothesis about what determines the intrinsic dimension of learning a quantum wavefunction. The findings are largely descriptive, and several are natural consequences of previously understood properties of random subspaces, variational bounds, and optimization. More interesting relationships between intrinsic dimension, Hamiltonian properties, expressivity, and optimization difficulty could have been theoretically motivated and empirically tested. For me to change my assesment of this paper it would require the authors to do substantial work that I think would be unreasonable and probably innacurate during a short rebuttal period.
-
Insufficient experimental diversity. The evaluation considers only two Hamiltonian families and one neural architecture family, with relatively small system sizes. This limits the generality of the conclusions, particularly those concerning sign complexity and optimization stability.
-
Limited statistical robustness. Several experiments use only two or three seeds, despite substantial seed dependence and multimodal optimization outcomes. This is particularly problematic when intrinsic dimension is defined by whether the median run crosses a fixed accuracy threshold.
-
Presentation. The writing would benefit from substantial revision. The introduction is not always well structured, and parts of the experimental discussion use repetitive or unnatural phrasing that obscures the main observations.
Questions for authors
-
What are the main insights or intuitions on the critical aspects that determine the intrinsic dimension of a wavefunction beyond Hamiltonian size and frustration? Are there any concrete hypothesis that you would formulate in this regard?
-
How sensitive are the conclusions to the choice of architecture? Would the same Hamiltonian exhibit comparable intrinsic dimensions under substantially different NQS parameterizations? Are there any chances that the intrinsic dimension depends also on the optimization method used (e.g. SR vs. Adam) or sampling procedure (auto-regressive vs. metropolis hastings)?
-
Given the strong seed dependence, how robust are the reported intrinsic dimensions to additional seeds and changes in the accuracy threshold?
8 comments
Response to Reviewer 4ALr (2/6)
W2 + Q1 (continued)
The test compares random maps with maps that replace the sole output direction by the direction toward zero output weights, which gives access to the uniform transverse product state. The network, initialization, other directions, and scales are fixed within each pair. At a given dimension and seed, both fields use the same maps. The grid, seeds and tolerances were registered before the 36 pairs at 8, 16 and 64 coordinates were run, and every state is scored by summation over all 65,536 configurations. The table gives the median error and individual 1% passes for six matched seeds per cell under one exact-energy L-BFGS-B protocol, and the first tested dimension whose median error meets each tolerance.
| Field/coupling | Map | 8 | 16 | 32 | 64 | First dimension meeting 1% | First dimension meeting 2% |
|---|---|---|---|---|---|---|---|
| 4 | Random | 22.106% (0/6) | 11.250% (0/6) | 4.610% (0/6) | 1.435% (0/6) | None on grid | 64 |
| 4 | Aligned | 1.357% (0/6) | 0.924% (4/6) | 0.410% (6/6) | 0.172% (6/6) | 16 | 8 |
| 1.2 | Random | 13.801% (0/6) | 6.574% (0/6) | 3.634% (0/6) | 1.978% (0/6) | None on grid | 64 |
| 1.2 | Aligned | 9.365% (0/6) | 6.595% (0/6) | 2.747% (0/6) | 1.405% (0/6) | None on grid | 64 |
Rows 1 and 2 compare the two maps at ratio 4. Replacing one direction lowers the first passing dimension from 64 to 8 at 2%. At 1% the random map has no passing point on the grid and the aligned map passes at 16. The intervention changes one trainable direction and nothing else. A separate sampled-SR comparison with 6,000 updates at 32 coordinates gives the same contrast, 0/6 against 6/6 passes at 1%, and its energy decomposition shows a lower transverse-field cost with bond correlations still present.
Rows 2 and 4, and rows 1 and 3, change the Hamiltonian. With the aligned map, changing the field ratio from 4 to 1.2 raises the first passing dimension from 8 to 64 at 2% and removes every 1% pass on the grid. With random maps both fields first reach 2% at the last grid point (medians 1.435% and 1.978% at 64 coordinates) and neither reaches 1%. The aligned map separates the two Hamiltonians, 8 against 64 at 2%, as the hypothesis predicts.
Optimization changes individual attainment near a threshold and leaves the first passing dimension unchanged. At ratio 4 the random-map dimension at 2% is 64 under the submitted SR training, independently rescored, and under exact-energy L-BFGS-B on a new cohort of maps. At ratio 0.95, SR and Adam on paired maps both first pass 2% at 64 coordinates (response to W3 + Q2). On the aligned maps of the table at ratio 4, replacing L-BFGS-B by 6,000 sampled-SR updates gives median errors of 1.358% at 8 coordinates and 0.882% at 16, against 1.357% and 0.924%. Individual 1% passes at 16 coordinates change from 4/6 to 5/6, and the first passing dimension stays at 16 at 1% and 8 at 2%.
On the frustrated lattice, expressivity enters through a class bound. No wavefunction with non-negative amplitudes can go below 52.7% error, and the non-negative network approaches that bound with 8 of 28,642 directions (Section 4.1). In the sign-capable model at a fixed total of 2,048 coordinates, moving coordinates from amplitude to phase lowers the median error from 23.03% to 5.20% and lowers the error in every matched pair, and supplying the exact sign at the same 1,938 amplitude coordinates lowers the median to 3.48%.
The submission tests competing explanations at three points. It tests a class bound against the state for the 8-direction result (Sections 4.1 and 4.2), too few sign dimensions against a costly sign for the failure of proportional allocation (Section 4.2), and a physical maximum against a threshold artifact for the 16-spin interior maximum, pre-registered and decided at 24 spins (Section 4.3 and Appendix E). The better-conditioned map trains worse (condition number to against , Section 4.1), and with 2 or 8 amplitude dimensions the learned sign gives a lower error than the exact sign (Section 4.2).
Response to Reviewer 4ALr (3/6)
W1. What is new beyond applying random-subspace methods to neural quantum states?
Reviewer concern. Limited novelty. The methodology largely transfers established techniques for measuring intrinsic dimension and optimizing in random subspaces to NQS. The stochastic reconfiguration formulation follows directly from the standard pullback of the quantum geometric tensor. The main novelty is therefore in the application and empirical observations rather than in the methodology.
Response.
The Introduction identifies the contribution as a measurement for variational Monte Carlo and the empirical findings it yields, proposes no new training algorithm, and states that to our knowledge no published work measures intrinsic dimension in this setting. The random-subspace construction follows Li et al. (2018), and stochastic reconfiguration applies to the latent coordinates through the standard pullback. What is new in the methodology is a set of controls that determine what a measured dimension means. They are a restricted wavefunction class whose attainable energy bound is known, separate coordinate budgets for sign and amplitude compared against a network with the exact sign, and a product-state limit that exposes the cost of the random slice (Section 4.3). The known ground-state energy distinguishes matching the optimum of a restricted model from approximating the target state. A small dimension can reflect an attainable bound of a restricted wavefunction class or the orientation and allocation of the trainable directions.
The positive-wavefunction example in Section 4.1 provides a concrete diagnostic. Measured against the full model, as the criterion of Li et al. prescribes, 8 of 28,642 directions lose almost nothing (0.5313 against 0.5271). Measured against the exact energy, both are about 53% away, because both approach the positive-cone bound. That the standard measurement cannot see the bound is the finding. The interventions described in our response to W2 + Q1 add an experimental test of the orientation and allocation interpretation. At field-to-coupling ratio 4, changing one direction lowers the measured dimension from 64 to 8 at a 2% tolerance. At a fixed total of 2,048 coordinates, moving coordinates from amplitude to phase lowers the median independently evaluated error from 23.03% to 5.20%. These are properties of the tested learning problem that the SR pullback alone does not determine.
Response to Reviewer 4ALr (1/6)
W2 + Q1. What determines the measured dimension, and what hypothesis can we test?
Response.
We thank the reviewer for the careful review, and for recognizing the exact-sign control, the positive-cone bound and the matched-solver stability result.
Our hypothesis is that a random slice imposes a floor on the measured dimension, that a direction matched to the dominant physical structure removes that floor, and that the dimension that remains follows the demand of the Hamiltonian. At a 2% energy target, the uniform transverse product state is sufficient at field-to-coupling ratio 4 and insufficient at 1.2. The hypothesis predicts that making this state reachable lowers the measured dimension at 4 but leaves it unchanged at 1.2. The first tested dimension meeting the target fell from 64 to 8 at 4 and stayed at 64 at 1.2. The test added after submission used six matched seeds, replaced one direction within each pair and evaluated energies over every configuration.
The floor is the submission's observation in Section 4.3. Deep in the paramagnet, random-subspace training needs far more coordinates than the state requires. At field-to-coupling ratios 4 and 10 a parameter-free product state is within 2% of the exact energy (1.5445% and 0.2495%), while random-map training first reaches 2% at 64 coordinates.
The strong-field expansion identifies the dominant structure and gives the prediction. At ratio 4 a nearest-neighbor trial state from the expansion reaches 0.00615% error, so the product state meets a 2% target and misses a 1% target that the correlated state passes. At ratio 1.2 the best product state has 4.2231% error and meets neither.
The controlled comparisons use the 16-spin transverse-field Ising chain and vary the field, the trainable directions and the optimizer. The three properties named in the review enter as follows.
Hamiltonian properties determine which physical structures are needed at a given tolerance. When the trainable directions give access to the uniform transverse product state, lowering the field-to-coupling ratio from 4 to 1.2 raises the measured dimension from 8 to 64 at a 2% tolerance.
Expressivity determines which states the trainable directions can reach. At ratio 4, replacing one random direction by the direction that reaches that product state lowers the measured dimension from 64 to 8 at 2%, and from no passing point on the grid to 16 at 1%.
Optimization difficulty determines which reachable states are found within the training budget. Replacing the optimizer changes individual runs near a threshold and leaves the measured dimension unchanged.