- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Leveraging symmetry via equivariant networks in RL lets agents share experience across symmetric states and actions, but when the symmetry is broken, exact symmetry priors introduce errors and fail to achieve optimal performance. Existing approaches using relaxed equivariance absorb the asymmetry into parameters the group does not act on, giving up exact equivariance. This paper proposes Group-context Symmetry Breaking (GSB), which treats the asymmetry as a learnable context that transforms with the group and extends the state-action space with it, so that exact equivariance holds on the extended space. The authors also prove that any strictly equivariant model leaves an error of at least half the largest symmetry deviation, whereas GSB’s error is bounded by its own approximation error. GSB achieves the highest mean return on three of four MuJoCo locomotion tasks with controlled symmetry breaking. In manipulation, it transfers best to unseen mirrored conditions, and ablations show that this gain comes from its context-based correction of mirrored transitions.
Critical strengths
S1. The main strength of this paper is a simple but principled reformulation of how equivariant RL handles symmetry breaking. Unlike prior methods that address symmetry breaking by partially relaxing equivariance, GSB models the asymmetry as a learnable context that transforms with the group and feeds it to the model as an additional input, retaining exact equivariance on the extended space. GSB opens a new direction for addressing symmetry breaking, and it can be added to a standard SAC agent with few changes to its policy and critic networks.
Critical weaknesses
W1. The simulation experiments lack key baselines and statistical support. In locomotion, GSB trains an SAC agent with transitions generated by its learned model. However, all baselines but PE-SAC are model-free SAC variants, and PE-SAC uses its learned model only to identify symmetry breaking, not to generate transitions for agent training. Thus, the gains may come from model-based data generation itself rather than from the group context. To isolate the effect of the group context, the authors should compare against model-based RL with equivariant and non-equivariant models, as well as plain orbit augmentation in locomotion. In addition, only three seeds are used for each experiment, which weakens the statistical support. Experiments on more seeds should be provided.
W2. The simulation experiments test only one kind of symmetry breaking, a hidden constant force applied to a single body. This is the setting most favorable to GSB, since the cause of the asymmetry can be moved by the group between corresponding bodies and the assumption of Lemma 9 therefore holds by construction with a low-dimensional context. Other forms of symmetry breaking, such as asymmetries with many sources (e.g., multiple fixed obstacles), which would require a high-dimensional context, are not evaluated. Experiments on more diverse types of symmetry breaking should be added to support the conclusion that broken symmetry remains a useful structural prior.
Questions for authors
Q1. Does GSB perform well in environments without symmetry breaking? Could the authors report results on exactly symmetric environments (e.g., the original tasks without the applied force)?
Q2. The return curves in Figures 5 and 6 are difficult to distinguish because of similar color tones and thick curves overlapping each other. Could the authors improve the visibility of the curves?
Q3. Throughout the manuscript, many technical terms and symbols are used without explicit definitions (e.g., the context ‘slice’ used from the abstract but not explicitly defined, and the discrepancy d_P in the main text), which makes the method hard to follow. Could the authors define the terms more clearly, with intuitive explanations?
Summary of the Discussion from authors
We thank the AC, SAC and PC for overseeing the discussion, and the three reviewers for their questions, which helped us state the theory more clearly. All three recognize the idea: the paper's focus "offers an inspiring direction" (zArq), GSB uses "a seemingly new parametrization" (VJdn), and is "a simple but principled reformulation" (Re3S). Below we summarize how each concern stands against the paper.
Most concerns ask for what the submission already contains. How the context enters the networks, which SAC components are equivariant, and why a state-independent context captures state-dependent effects (zArq) are stated in Sec. 3.2, Sec. 3.4 and Fig. 3; slice and d_P (Re3S) are defined in Sec. 3.2 and App. A. Our replies pointed to each location and explained it again in plain terms.
The shared soundness concern is ruled out by the paper's own experiments. zArq and Re3S suggested that the gain may come from model-based data generation rather than the group context. In manipulation, no method generates transitions for agent training, yet GSB ranks first in held-out return in every seed. On Hexapod, the same model-based pipeline with only the context frozen falls below GSB in every seed (Sec. 4.2–4.3). We also ran the requested model-based controls on all four locomotion tasks.
Where a question pointed to a real improvement, we made it. Following VJdn, the revised paper will state a tighter form of Proposition 2 and remove the context bound, which no result needs. Following Re3S, it will improve Figs. 5 and 6. No concern identified an error in any result or a claim without evidence.
How the discussion ended. We especially thank VJdn for the follow-up questions over four rounds; we did our best to answer them and to refine the theory accordingly. The remaining remarks, that Proposition 1 feels obvious and Appendix C limited, are judgments of significance: Proposition 1 proves what the subset relation cannot, a floor of Δ/2 on the worst-case error of every strictly equivariant model, and Appendix C proves that the group alone fixes the context dimension. Although zArq did not take part in the discussion, we hope that the paper and our reply clear up the misunderstandings in the review: each concern is answered in the submission, ruled out by the evidence above, or, for images and real robots, beyond what the closest baselines, PE-SAC (ICLR 2026) and RPP (NeurIPS 2021), evaluate. We respect Re3S's decision to keep the score. If Re3S still sees a substantive problem that warrants rejection, we would welcome having it pointed out.
In sum, every concern in the reviews is answered in the submission, ruled out by its experiments, or addressed by a revision, and none was left unanswered in the discussion. We hope the AC, SAC and PC will weigh the reviews in this light, together with the paper's proofs and its experiments on six tasks.