- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces GenSymAudit, a sample-based framework for auditing whether a deployed generative model preserves, amplifies, or attenuates the symmetry properties already present in real data. For each transformation in a finite group such as rotations and reflections in , the method uses classifier two-sample tests to measure how distinguishable the original samples are from their transformed versions, separately for the real-data anchor and the generated distribution. It then subtracts these two asymmetry scores and applies bootstrap confidence intervals, multiple-testing correction, equivalence testing, negative controls, and quality gates to produce transformation-specific verdicts. Experiments on DiffusionSat and Text2Earth show that some asymmetries are inherited from their respective real datasets, while others are selectively amplified or attenuated by the deployed generators. The paper argues that anchor-relative auditing provides a more informative assessment than simply testing whether generated data are perfectly symmetric.
Critical strengths
A key strength of this paper is its careful and systematic statistical evaluation. By comparing generated data against a matched real-data anchor, the framework can distinguish asymmetry inherited from real data from changes associated with the generator. Its element-wise analysis, together with bootstrap uncertainty, negative controls, multiple-testing correction, and equivalence testing, makes the resulting audit more reliable and interpretable than a simple test of absolute symmetry.
Critical weaknesses
The main weakness of this paper is its limited novelty and significance. It mainly extends existing symmetry-auditing methods into a more elaborate statistical pipeline, while the underlying problem of whether generative models preserve data symmetry has already been studied [1, 2]. Moreover, similar anchor and generated-data scores indicate only comparable levels of separability, not necessarily preservation of the same underlying symmetry structure. Although the paper includes downstream experiments, the observed performance gaps may arise from many differences between real and generated data, and the reported associations with symmetry shifts remain exploratory and inconsistent across datasets. The paper therefore does not establish a causal link between the detected distortions and downstream harm, nor does it propose a method for correcting them.
- Caytuiro, Nicolas, and Ivan Sipiran. "Symmetry matters: Auditing and symmetrizing 3D generative models." Computers & Graphics (2026): 104687.
- Lawrence, Hannah, et al. "To augment or not to augment? diagnosing distributional symmetry breaking." International Conference on Learning Representations. Vol. 2026. 2026.
Questions for authors
How can the authors demonstrate that similar symmetry scores for the anchor and generated distributions indicate preservation of the same underlying symmetry structure, rather than different asymmetries of similar magnitude?
What is the key novelty of GenSymAudit compared with existing symmetry-auditing methods and a simple subtraction of two C2ST-based symmetry scores?
Can the authors causally isolate the effect of the detected symmetry deviations on downstream performance, for example through a controlled intervention that changes symmetry while preserving other aspects of generated-data quality?