- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper studies canonicalization, i.e., the idea to obtain invariance of a prediction to a group action, by considering the orbit of any input, and feeding a fixed member of the orbit into an ordinary predictor. In particular, it considers the case where a continuous selection of a fixed member of the orbit is not possible (referred to as an \textit{obstructed} domain). It shows that Lipschitz constants of an approximation to such a canonicalization must have an unbounded Lipschitz constant as the approximation becomes more invariant to the group action and the distance of the approximation to the true orbit goes to zero. Numerical results support the presented theory, and highlight that there is an inherent trade-off between stability, precision of the approximate canonicalization, and computational costs (by considering/averaging multiple inputs).
Critical strengths
The paper studies an interesting and important problem from a theoretical perspective and discovers an interesting trade-off that is subsequently investigated in several numerical experiments. The work deduces concrete recommendations for future works on approximate canonicalization to make the inherent trade-off visible. Thus, it could be of interest to the community due to novel theoretical insights as well as for its concrete recommendations.
Critical weaknesses
I found this work very difficult to read. It quickly dives into the topic, requires strong prior knowledge on the respective mathematical objects, and does not really preserve a big picture with concrete examples of groups and subsets of metric spaces that lead to an obstruction. Considering that the manuscript did not fully use the available nine pages, the big picture for non-expert readers could have been more pronounced. While this is partially ok for a theory-heavy work, it is unfortunate that not even the experimental section is easily readable and self contained: The group actions associated with the five dataset considered are not explained in the main paper, "protocol details" are in the appendix only, sections dive into technical aspects without an introduction (e.g. Sec. 5.3 starts with "For PCA alignment, we normalize eigenvalue gaps by total variance" without introducing the dataset or task the current section is studying), and neither Table 1, nor Fig. 3, nor Fig. 4 are explained or even referred to in the text.
Questions for authors
Can the authors please provide a bigger picture, e.g. with the help of a concrete example, and introduce the numerical experiments conducted?
This question/suggestion should be viewed in the light of my low confidence about the overall assessment, i.e., if researchers more familiar with the topic find the paper well written and easy to follow, feel free to ignore the above point. I would, however, consider a reference and explanation of all tables and figures as very important in any case. In addition, to my mind, the main paper should always be self contained and thus fully understandable without considering the appendix.
We thank the reviewer for the constructive suggestions concerning accessibility, the overall narrative, and the presentation of the experiments. We agree that the original manuscript introduced mathematical concepts too quickly and did not sufficiently explain the experimental settings and their relationship to the theory in the main text. We have substantially reorganized the presentation while preserving the original mathematical results and cross-domain investigation.
1. A concrete running example now introduces the problem
Section 1 now explains the stability obstruction through quaternion sign selection before introducing the formal mathematical framework. Two opposite unit quaternions, q and −q, encode the same physical 3D rotation. Choosing one sign produces an invariant, orbit-valued representation away from the selection boundary, but nearby inputs crossing that boundary can yield distant outputs. Figure 1 illustrates both the discontinuity and the alternative of continuously fading the representation toward zero. The latter removes the jump while sacrificing orbit membership.
This example introduces invariance, orbit fidelity, and stability in concrete terms and reappears in Sections 4 and 5. We believe it makes the central question accessible without requiring prior familiarity with quotient spaces or topological sections.
2. The experimental section is now more self-contained
We have reorganized Section 5 so that the main text explains the purpose, symmetry action, and principal findings of each study. Table 1 explicitly identifies the physical meaning of the group action for all five datasets and summarizes the evidence obtained from each. The experimental subsections now follow a clear progression:
Essential definitions of representation sensitivity, training controls, evaluation settings, and uncertainty are now provided in the main text, with detailed protocols and audit tables retained in the appendix. We also clarify distinctions that were previously insufficiently explained, including physical pose changes versus canonical-object changes and molecular energy invariance versus force equivariance.
3. Figures and tables are now explicitly introduced and interpreted
We have revised the presentation so that every main-text figure and table is referenced and explained in context:
Tables 1 and 2 are likewise introduced and discussed in the main text, with Table 2 explicitly distinguishing orbit fidelity from invariance. The main results and their interpretations no longer require consulting the appendix, while complete reproducibility details remain available there.
We appreciate the reviewer's emphasis on communicating the big picture. The revised narrative now proceeds from a concrete obstruction, through its quantitative characterization, to calibrated evidence and data-dependent consequences, making the contribution accessible to a broad machine learning audience.