- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a bound on subspace error between estimated and ground truth symmetries in the context of generator-based discovery of global subgroup symmetries which use a vector field formulation. The authors provide a taxonomy of symmetry discovery based on many recently-published methods of symmetry discovery.
Critical strengths
Strength 1: this paper begins to address an important aspect of symmetry discovery, which is the tendency of existing methods to consider different metrics for success.
Strength 2: this paper shows potential, but requires revision before publication should be considered.
Strength 3: this paper seems to be sufficiently comprehensive in terms of the most recent and salient symmetry discovery methods considered.
Critical weaknesses
Weakness 1: The paper is not sufficiently rigorous from a mathematical point of view. The field of symmetry discovery sits at the intersection of machine learning and the rich and rigorous field of differential geometry (and adjacent mathematical fields). As such, advances in symmetry discovery must be sufficiently rigorous, not merely as a service to mathematics, but rather that the reader can precisely understand the claimed contribution. My opinion is that the paper in its current form is imprecise so as to obscure the claimed contributions, and that publication in its current form would enable incorrect notions of symmetry discovery to persist. To support this argument, I present the following examples as a subset.
(1) In section 2, it seems that the principle of symmetry is summarized by the so-called symmetry relation This is objectionable in part because it is not defined: moreover, efforts by the authors to justify their claim that each symmetry method studied can be reduced to the task of producing are absent, or so apparently. This is not fully resolved in Appendix E.
(2) The proposed taxonomy may ultimately be suitable, but the authors do not discuss or acknowledge the simplicity thereof. In the target object "dimension," for example, lines between so-called functional symmetry and distributional symmetry are blurred when the underlying distribution can be described by a probability density function. Locality is another case where lines can be blurred, as vector fields can define local or global flows.
(3) Section 3.1 (specifically lines 167-176) begins with "Let X be the data domain..." which seems quite general. But subsequent statements imply much stronger assumptions about the structure of the so-called "data domain;" e.g., that it has a tangent space with a norm. I think the authors should be more clear/specific about what precise mathematical construction is needed/assumed, including about the probability measure q. The statement "the Hilbert space in which infinitesimal generators are represented as vector fields" moves too quickly in the sense that the authors should more formally introduce symmetry and infinitesimal generators in the context of their focus, which is generator-based discovery of global subgroup symmetries using vector field formulation (and sometimes matrix generators). Additionally, lines 172-177 are simply not sufficiently explained: in fact, it is not clear to me how the operator is defined.
(4) In line 191, is not defined.
(5) I don't believe the authors have actually accurately captured symmetry discovery in the case of distributional symmetry: the authors should connect their provided infinitesimal condition to their cited sources, such as Yang et al., 2023.
Weakness 2: the paper attempts to introduce a taxonomy in a way that only a survey can do. Many claims about the methods considered are simply not justified because there is not room in a 9-page conference paper to do so. However, this leaves critical gaps in the justification of the proposed taxonomy (some of which tie in to weakness 1). This is not resolved in Appendix E.
Weakness 3: some contributions do not seem warranted. In lines 239-240, the authors claim to have reformulated generator-based symmetry discovery as the problem of recovering the kernel of a task-specific symmetry-measuring operator. But it's not clear that this is a novel reformulation, particularly given Otto et al., 2024 and Shaw et al., 2024, in which symmetry discovery is explicitly described as recovering such a kernel or nullspace. Additionally, the subspace distance question seems to have already been taken up in Hu et al. in their paper introducing LieNLSD: at the very least, an empirical comparison should be attempted.
Weakness 4: The proposed taxonomy distinguishes linear and nonlinear approaches, but the experiments seem lacking in the nonlinear category. Furthermore, despite the assurance of a vector field focus, any recovered generators appear to be matrices.
Weakness 5: in terms of writing-specific weaknesses, my impression was that terms/phrases were emphasized excessively, and that much of the paper was too conversational/informal.
Questions for authors
Question 1. What is the purpose of encouraging orthonormality (section 3.1, lead-up to equation 3)? Some existing methods already attempt to impose orthonormality, whereas the writing does not address this, seemingly claiming to introduce orthonormality as a novelty.
Question 2. Is the reference to Yang et al., 2023 in both the functional and distributional target object sections in Appendix E intentional?
I appreciate the authors' dilligence in supplying explanations and revisions, which have changed my perception of the paper. I believe conference attendees would find this work to be of interest, and I have raised the overall score accordingly.