- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
this paper proposes a framework that constructs energy-induced representations from prescribed energy functionals and extracts spectral features. results demonstrate that energy structure can provide informative and computationally efficient representations without learning the feature extract or from data.
Critical strengths
- results on structured classification task looks good
- The paper explores the use of prescribed energy functionals as a source of discriminative representations. Separating feature construction from supervised classifier training is an interesting direction, particularly for settings in which useful domain-specific structure is available.
Critical weaknesses
The main experiments primarily compare EnRep against raw-pixel ridge regression and a shallow CNN. While these comparisons demonstrate that the proposed representation can be useful, they do not establish whether the GL energy is responsible for the performance improvements. The paper would benefit from comparisons against stronger deterministic representations, including gradient-based texture descriptors, wavelet scattering, and appropriately matched spectral or polynomial features. Dimension-matched comparisons would be particularly helpful. Without these controls, it remains difficult to determine whether the gains arise specifically from the prescribed GL energy or more generally from introducing suitable nonlinear features and spatial inductive biases.
Questions for authors
- Can the authors provide component-wise ablations that isolate the contributions of the gradient-energy term, potential-energy term, and spectral aggregation? How would the results change with a different prescribed potential?
- Given that the raw spectral baseline substantially outperforms EnRep in the smallest MNIST training regime, under what conditions should one expect the energy transformation to improve rather than degrade discriminative information?
Dear Reviewer Li2x,
Thank you for your detailed and constructive suggestions. We agree that the original experiments did not sufficiently distinguish the contributions of energy-derived transformations, spectral organization, and feature dimensionality. We have expanded the ablation studies in the revised manuscript to address these concerns.
Appendix H (Table 13) now evaluates the gradient and potential components of GL-EnRep separately under both Energy-Density (ED) and Energy-Decomposition (EDec) modes, alongside Ki-EnRep and dimension-matched raw spectral features.
For the 150×150 colorectal histology benchmark, the results at the same 197-dimensional feature size are:
For 28×28 histology, the corresponding accuracies are 25.48%, 41.08%, 43.93%, and 44.32%, respectively.
These comparisons indicate that feature dimensionality alone does not explain the improvements observed on histology. They also show that informative representations can arise from different prescribed energy functionals.
Nevertheless, we do not claim that these results uniquely identify the physical interpretation of GL energy as the cause of improved classification. The nonlinear transformations and their associated inductive biases may also contribute.
The original concatenated GL-EDec representation achieves 54.44% and 58.46% on the two histology benchmarks. Because it contains 393 features rather than 197, its advantage over individual components cannot be attributed solely to their complementarity. We explicitly acknowledge this limitation in Appendix H.
We agree that the benefit of energy-induced representations is task-dependent.
The revised experiments use per-image min-max normalization without feature-wise standardization. Section 3.5 explains that standardizing individual spectral coordinates would remove the Laplacian eigenvalue weighting in the GL gradient-decomposition features, thereby altering their intended frequency-dependent scaling.
At the smallest MNIST split (200 training / 50 test), GL-ED achieves 76.40%, compared with 73.80% for Raw Spectral. However, at the 2,000/500 split, Raw Spectral achieves 84.22%, while GL-ED achieves 84.08%, and the other evaluated energy-derived representations perform worse.
The dimension-matched ablations also show that improvements are not uniform across datasets. For example, on the Turing 36-class benchmark, the differences between raw spectral and individual GL components are relatively modest and vary by construction.
Thus, our results do not establish that energy transformations universally improve discriminative information. The strongest improvements appear on the histology benchmarks, where spatial morphology and texture may be particularly relevant to energy-derived features. We have revised our interpretation accordingly.
To examine whether the framework is restricted to GL energy, we have introduced Ki-EnRep, based on a quadratic deviation from the pixelwise training-set mean image.
The reference image is computed without class labels and remains fixed when processing test inputs. Thus, Ki-EnRep does not require a learned feature extractor, although its construction uses an unlabeled training-set statistic.
We emphasize that Ki-EnRep provides a second prescribed energy functional rather than a direct replacement of the GL double-well potential.
Appendix B provides raw spectral comparisons, Appendix C examines mode-count sensitivity, and Appendix H evaluates individual energy components under matched feature-vector dimensions.
We appreciate your suggestions, which have helped us strengthen the experimental analysis and clarify both the contributions and limitations of EnRep.