- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces a pooling operator Geometric Mean Pooling (GMP) computed by combining the product of feature signs with the geometric mean of the magnitudes. The authors compare GMP to max and average pooling operations on synthetic and real datasets including classification and regression tasks. In the synthetic tasks, the labels were generated with signed parity and geometric mean statistics. Accordingly, GMP consistently outperforms average and max pooling in those tasks. The experiments also show GMP keeps the performance advantage under increasing strengths of noise and an ablation without the signed term. On image classification tasks, GMP consistently underperforms or performs similarly to the other operations. On a molecular regression task, using a transformed exponential scale one of the configurations that includes GMP has a slight advantage. On the original scale all configurations with GMP underperform.
Critical strengths
Evaluations on the synthetic datasets. The paper includes extensive evaluations on synthetic datasets, including classification and regression tasks. On these engineered tasks, GMP has a clear advantage over max and average pooling. The authors also present an ablation on the signed term for the classification tasks. Empirical workflow. Multiple seeds in most experiments, evaluation of local and global placement combinations for pooling operations, open code.
Critical weaknesses
Limited methodological novelty. The unsigned geometric mean pool was established in previous work [1], so the novelty of the proposed method here is limited to the introduction of the signed term. Limited comparisons with other pooling operations. GMP is only compared against average and max pooling for the main performance experiments. In particular, comparison against the unsigned geometric mean is critical to establish the advantage of the new method. Weak results on image classification. GMP performs similarly or substantially worse than max/avg pool on all the image classification tasks. Inconclusive results on lipophilicity regression. On the lipophilicity regression task with the transformed task, global GMP and local max have the best mean, but the standard deviation bars overlap with the other operations under local max. It is unclear if the global GMP advantage is statistically significant or not. Furthermore, without transforming the labels, GMP consistently underperforms compared with the pooling alternatives (Appendix E). Lipophilicity experiment reduces to geometric mean pool. In the lipophilicity model, since the convolutional blocks use a softplus activation, the inputs to the pooling operations are all positive. In this case GMP reduces down to the established unsigned geometric mean pool operation, so in any case this experiment does not evaluate the sign term which is the novel component in the paper. Lipophilicity baselines. The motivation behind the lipophilicity baseline comparison is unclear. If the motivation is a comparison with the paper’s 2D CNN then they are not directly comparable as the baselines use the standard scale while the 2D CNN model uses the transformed target. If it is to motivate the use of the Morgan fingerprints in the 2D CNN then that should be emphasized more clearly.
[1] Kortvelesy, Ryan, Steven Morad, and Amanda Prorok. "Generalised f-mean aggregation for graph neural networks." Advances in Neural Information Processing Systems 36 (2023): 34439-34450. [2] Wu, Ang-Kun, et al. "Compact Spin-Charge Separated Neural Quantum States for Valence-Bond States." arXiv preprint arXiv:2606.17045 (2026).
Questions for authors
Can you clarify the difference between the GMP operation used in [2] to the one you are introducing here? For the lipophilicity task, can you evaluate the models from figures 5 and 6 on the same scale so they will be directly comparable? In Figure 5, is the advantage of the local max with global geo statistically significant compared to the other local max models?
Minor: In figures 4 and 5 the error bars are cut off by the upper/lower limit of the y-axis. Some acronyms are undefined (RG) or used before they are defined (GMP) in the main text.
References: [1] Kortvelesy, Ryan, Steven Morad, and Amanda Prorok. "Generalised f-mean aggregation for graph neural networks." Advances in Neural Information Processing Systems 36 (2023): 34439-34450. [2] Wu, Ang-Kun, et al. "Compact Spin-Charge Separated Neural Quantum States for Valence-Bond States." arXiv preprint arXiv:2606.17045 (2026).
3 comments
Thank you to the authors for their detailed response and for running the additional experiments. The relationship to Wu et al., 2026 is clear, the new spin chain prediction supports the need of the sign term on a non synthetic task, and the molecular regression task is now standardized to the original log scale.
The overall contribution remains marginal as the empirical results are insufficient, especially given the pooling operation itself is not new (Wu et al., 2026). These are my major remaining concerns:
- The experimental evidence on non synthetic data is still limited. In the molecular regression task, signed GMP is not evaluated and the unsigned variant does not show a clear advantage compared with max-avg pooling baselines. The spin chain task does show the need for the signed term, but it is just a single example and the log/phase model outperforms it. The baseline pooling operations (max / avg) are not evaluated for this task. This is not enough to establish the broader benefit of the method. In the authors’ view, based on the results in this work, what is the use case for GMP?
- The empirical characterization remains underdeveloped. Why was image classification chosen to show the sensitivity to activation, clamp, and placement choices? Can the authors show or clarify which conclusions they expect to generalize to tasks where GMP would be applied? Using Softplus activation in the molecular regression experiment makes it unclear whether the conclusions generalize to the signed operation. To a lesser extent this also applies to the image classification experiments with the ReLU activation, which removes the negative sign. The characterization results would be stronger with activations that retain negative values (like tanh used in the spin chain task) and on tasks where GMP would realistically be applied.
- In Figure 4, the caption reads “the reported score is the maximum accuracy on the official test set across training epochs”. Can the authors clarify the way the tested checkpoint was chosen? Was it not not chosen based on the validation set?
Other minor concerns:
- It should be stated clearly in the manuscript that GMP operation has been used in previous work and the objective of this work is to study the machine learning aspects.
- In the QUANTUM MANY-BODY AMPLITUDE LEARNING section, and are not explicitly defined in the main text.
Response to the remaining concerns and updates in the revised manuscript
Thank you for the follow-up. We have added matched pooling baselines, signed-feature controls and an exact singlet-product benchmark. The molecular numbers below supersede those in our earlier response: standardized-target fits have been replaced by raw-target experiments.
1. Intended use case and contribution.
GMP supplies a parameter-free prior when local factors combine multiplicatively and their sign parity matters. Singlet-product amplitudes provide a concrete physical example: local rules take values {−1, 0, +1}, and their product gives the amplitude up to normalization. We now test this setting at the exact J2 = 0.5 point of the uniform J1–J2 chain (J1 = 1). The manuscript explicitly credits Wu et al. (2026) for using the signed operation; our contribution studies its machine-learning behavior. We do not claim broad superiority on image or molecular tasks. Our results support GMP as a structural prior for problems with known signed multiplicative structure, illustrated here by quantum-state amplitudes and controlled synthetic benchmarks.
2. Quantum pooling baselines and the log/phase alternative.
All methods use the same tanh backbone, comparable head budgets, 2000 updates per learning rate and validation-only checkpoint/rate selection. Held-out signed overlaps are:
| Model | J2 = 0.5 | J2 = 0.7 | J2 = 1 |
|---|---|---|---|
| Signed GMP | 0.999875 ± 0.000108 | 0.9878 ± 0.0040 | 0.9258 ± 0.0147 |
| Unsigned GM | −0.0472 ± 0.0613 | −0.0336 ± 0.0402 | −0.0616 ± 0.0920 |
| Average | 0.7119 ± 0.2944 | 0.9237 ± 0.0817 | 0.7944 ± 0.1869 |
| Max | −0.0637 ± 0.2006 | 0.3288 ± 0.2458 | 0.2775 ± 0.1798 |
| Log/phase | 0.9571 ± 0.1286 | 0.9952 ± 0.0026 | 0.9761 ± 0.0070 |
Entries are mean ± sample SD over three configuration splits and three initializations per split (Section 4.5, Table 2; Appendix G, Tables 13–15).
At J2 = 0.5, GMP reaches overlap 0.999706–0.999976 and 100% Born-weighted sign accuracy in every run, exceeding average in all nine matched runs. This supports stable learning of a physically defined singlet-product state. The three-split GMP-minus-average interval remains broad, +0.2880 [−0.2726, 0.8486], and the corresponding intervals at J2 = 0.7 and 1 also include zero; we do not claim statistical significance. The signed/unsigned contrast supports preserving signs in this architecture.
Log/phase uses a learned cosine phase modulation multiplying a positive envelope. It reaches near-unit overlap in eight of nine J2 = 0.5 runs; one reaches 0.6141, accounting for its lower mean. It achieves higher mean overlap at J2 = 0.7 and 1. We retain it as a useful alternative, not a resolved GMP win. The evidence covers one spin-chain family.
3. Molecular sign controls and the size of the benefit.
You are correct that Softplus removes negative features, so that experiment tests geometric magnitudes rather than sign preservation. Appendix E also compares signed GMP, unsigned GM, average and max with tanh, fixing local max. Targets are raw y = log10(D), auxiliary exp(y), or physical D = 10^y, without shifting or scaling.
Figure 5 evaluates nine placements at epoch 200 over ten seeds on one scaffold partition: local-max/global-GMP gives R² = 0.3545 versus 0.3466/0.3460 for global max/average, a marginal lead. The matched comparisons use five scaffold partitions, three seeds and minimum native-target validation RMSE. On raw exp(y), Softplus GMP/average R² values are essentially tied (0.3049/0.3056), versus 0.2697 for max. With tanh, signed GMP is below average/max on exp(y) (0.2668 vs 0.2958/0.2987) and raw y (0.4294 vs 0.4920/0.4985), though above unsigned GM on raw y (0.3506). These controls do not establish a general molecular advantage (Tables 6–11). Both partitioning and selection differ from the placement study.
4. Characterization and generalization.
Images serve as familiar learned-feature stress tests of placement and activation compatibility. Sign removal, exact zeros and small magnitudes affect GMP across tasks; optimal activations, clamps and placements remain task-dependent. We added tanh molecular controls and tanh/LeakyReLU activation/clamp controls on the physical task. Increasing the tanh GMP clamp from 10^−6 to 10^−3 changes overlap at J2 = 1 from 0.9258 to 0.9588. Unsigned GM partially recovers with LeakyReLU, showing representation dependence (Appendix G, Table 14).
5. Figure 4 selection and notation.
Figure 4 reports each run's maximum official-test accuracy across epochs, without independent validation selection; we now explicitly identify these as optimistic test-set maxima. Appendix D.1, Table 5 instead uses a held-out training split for checkpoint selection. Section 4.5 defines total magnetization S^z_tot and the prediction ψ̂(s). The molecular figures display full SD whiskers.
Thank you again for your careful feedback. We hope the added controls and clarified scope make the contribution and its limitations clearer.
Response to Reviewer Wd85
Thank you for highlighting the prior-work relationship, sign controls and molecular comparability. For GMP, we clarify prior work, add sign controls and correct molecular evaluation.
Q1 / novelty concern: How does GMP differ from the motivating quantum-state paper?
Compact Spin-Charge Separated Neural Quantum States for Valence-Bond States (Wu et al., 2026; your [2]) provides the original physical motivation for GMP. It studies quantum-state representation using the same signed global operation, as stated in the Introduction.
Here we study the machine-learning aspects of GMP as a pooling/coarse-graining primitive: local/global placement, learned features and training behavior across controlled, image, molecular and physical tasks. Composition analysis identifies preserved statistics; the quantum benchmark uses Hamiltonian-defined targets. Sections 2–3 discuss generalized mean pooling (GeM), generalized f-mean aggregation (GenAgg) and renormalization-group (RG) analysis. GM denotes unsigned geometric mean pooling.
Weakness: Missing unsigned comparisons and the role of the sign term.
At n = 1000, signed/unsigned balanced accuracy is 100.00%/49.77% on A and 94.32%/50.63% on B; positive R1 gives identical mean squared error (MSE). Table 1; Appendix F, Table 9.
We also learn signed coefficients of up/down configurations in the lowest-energy state of an open 16-spin chain. Numerical diagonalization supplies labels; J2 couples sites two steps apart, with adjacent-site coupling 1.
Overlap is held-out cosine similarity, mean ± descriptive standard deviation (SD) over three splits and three initializations per split. Models share a convolutional neural network (CNN) and comparable head budgets; spin-flipped/reversed configurations stay together, selection uses validation, and sign calibration uses training. The signed/unsigned contrast supports useful sign preservation on physical data. Learned log/phase, an exponential/cosine wavefunction readout, reaches higher overlap. Section 4.5, Table 3; Appendix G, Table 10.
Weakness: With positive Softplus inputs, molecular GMP reduces to unsigned GM.
Indeed, positive softplus inputs make signed GMP equal unsigned GM. The molecular task therefore studies magnitudes and placement; the controlled and quantum ablations test the sign term.
Q2 / molecular-baseline concern: Same-scale evaluation and purpose of the baselines?
Replacement Table 2 compares all seven models on original logD units using shared Morgan fingerprints, five scaffold partitions (molecules sharing a framework stay together) and three runs per partition. Direct-logD root mean squared error (RMSE) is 0.866 for max/max and 0.887 for max/GM; max/GM versus max/average is unresolved (paired difference +0.00108 [−0.00444, 0.00660]). CNN labels denote local/global pooling.
Fingerprint baselines give reference performance without CNN pooling on the same inputs/splits; CNN variants isolate local/global aggregation.
We also test the base-10 inverse, 10^y. Max/GM has lower recovered-logD RMSE than max/max (1.126 versus 1.214), although both remain worse than direct-logD training. Section 4.4; Appendix E, Tables 7–8 gives paired comparisons and separates transformed-target scores from scores mapped back to logD.
Q3 / statistical-support concern: Is the apparent local-max/global-GM advantage supported?
The expanded, validation-selected evaluation does not support the apparent exp(y) advantage of global GM. For max/GM minus max/max, the transformed-target test R² difference is −0.02738, with descriptive 95% t interval [−0.04800, −0.00676]. The single-partition advantage is not reproduced under this common protocol.
Runs are averaged within each partition; intervals use the five partition means and describe sensitivity to these overlapping partitions.
Weakness: Image-classification performance.
Image/molecular studies explore transfer from the motivating scientific multiplicative setting. The CIFAR activation/clamp study raises ReLU global GMP from 82.49% to 84.54% with epsilon 10⁻³, versus 84.34% for matched average pooling (Appendix D.1, Table 6). This characterizes training sensitivity without claiming broad superiority.
Minor comments: Clipped error bars and undefined acronyms.
Plots show full SD whiskers; captions define seeds, symbols, scales and selection rules. We checked acronyms throughout the manuscript and captions and expanded them at first use, including GM, SD, GMP and RG.
Do the clarified contribution, sign controls and corrected molecular analysis address your main concerns?