- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes another way of exploiting proper pointwise symmetry beyond scalar gates to leverage group symmetry in reinforcement learning. They recover event-conditioned local symmetry projectors. The proposed method is novel, and the paper demonstrates promising results in the MuJoCo orbital-contact task. Overall, the paper proposes a theoretically motivated way to use proper symmetry in RL, but the validation is unclear.
Critical strengths
- Symmetry-breaking and overcoming it in reinforcement learning is a significant problem, and the authors address the problem in a reasonable and straightforward way.
- Through event-conditioned compatibility, they recover the local subspace and leverage the geometric information in the subspace for RL’s state-action canonicalization.
Critical weaknesses
- Although the results were promising, the strong baseline is missing. The baselines mostly focus on ablations or standard RL approaches and do not compare with symmetry-aware RL, especially PE-SAC [1] or ApproxEquivariant RL [2], which address the same problem. Though these approaches might not support contact-rich local symmetry, the paper requires direct comparisons with previous approaches.
- The main motivation of the paper is to properly exploit symmetry in RL. However, the benefit of a full projector in RL comes from a single MuJoCo orbital-contact task.
[1] Chang et al. "Partially equivariant reinforcement learning in symmetry-breaking environments." International Conference on Learning Representations. Vol. 2026. 2026.
[2] Park et al. "Approximate equivariance in reinforcement learning." arXiv preprint arXiv:2411.04225 (2024).
Questions for authors
Could the authors strengthen the experiments by comparing with stronger baselines and adding more RL benchmark environments to support the motivation? For example, compare PE-SAC with the candidate SE(2) algebra in the same orbital task.
3 comments
I thank the authors for the detailed response. The additional results comparing with PE-SAC, Approximate Equivariance RL, and Egocentric SAC substantially address my concern regarding the lack of baselines. However, the additional results also raise new questions regarding practical benefits of the recovered projector. While the proposed approach improves over PE-SAC in terms of endpoint regulation and contact occupancy, it achieves comparable AUC and success rates. Also, Egocentric SAC outperforms the proposed approach, suggesting that the body frame representation may account for the performance gain rather than the projector. My concern regarding evaluation across diverse RL environments also remains, though the authors clarified their claims. Therefore I am leaning towards maintaining my current score.
Response to Reviewer WgZ8
Thank you for the follow-up. We agree that on this task the body frame accounts for the gain. Showing a practical benefit of the projector, in settings where no observed frame provides the valid symmetry and across more environments, is the main direction for our next version.
Response to Reviewer WgZ8
Thank you for the concrete suggestion to compare with PE-SAC.
Summary.
New experiments
All methods use seeds 9400–9419, the same splits, observations and action bounds. Results are on the 12 centers held out from policy training.
Recovered full trains for 100,000 steps after 17,784 recovery calls; the other methods train for 117,784 steps. Protocols: Appendix C.3 (p. 26); learning curves: Figs. 5–6 (pp. 27–28).
Table A — Results at 117,784 simulator calls (revised Table 1, p. 8)
Means over 20 seeds and 12 centers. AUC is normalized by the total-call budget; other columns are endpoint values.
Table B — Recovered full minus comparator, 95% paired bootstrap CIs (revised Table 8, p. 27)
The policy observation contains only free vectors and scalars, so rotation about the obstacle center acts on it exactly as rotation about any other point does, and the observed heading already gives an invariant frame. We expect the recovered projector to carry information a body frame lacks when observations include position-type quantities (absolute pose, contact or landmark positions); this remains untested.
W1 and Q1 — Stronger baselines
See Tables A–B above. The policy observation contains only free vectors and scalars, and on it SO(2) captures the orbital action seen by the PE-SAC equivariant branch (Appendix C.3, p. 26). We did not run a full SE(2) variant.
W2 and Q1 — More environments
We agree, and we did not add another RL environment during the discussion period. The billiard and obstacle studies evaluate recovery only (§4.1, p. 5), and the wall study does not show an advantage for full operators (Table 13, p. 31). The revised contributions (§1) and discussion (§5) limit the claims accordingly.