- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents a empirical investigation with useful insights into the evaluation of complex-valued neural networks. However, its methodological novelty is relatively limited, and the broader claims are not yet sufficiently supported by experiments across diverse architectures and real-world tasks.
Critical strengths
-
Using the geometrically controlled RadioML task, the paper demonstrates that complex-valued networks offer advantages only within a narrow signal-to-noise ratio (SNR) range (approximately 2–6 dB) characterized by low SNR and significant phase noise; this crossover point remains stable across varying class compositions and sequence lengths. The authors identify three confounding factors—incomplete baseline sets, selection bias, and insufficient training budgets—that effectively explain why the advantages of complex-valued networks were overstated in previous literature.
-
The paper reinterprets complex-valued layers as U(1)-equivariant subspaces formed by stacked real-valued dual-channel layers, positing that symmetry constraints—rather than the complex data type itself—are the true drivers of performance; this hypothesis is validated through experiments with constrained real-valued networks. Furthermore, the authors systematically analyze the task-dependency of complex activation functions, proposing that |z|-gating should serve as a diagnostic indicator rather than a fixed prescription.
Critical weaknesses
- Limited methodological innovation. The experimental analysis in this paper focuses on existing complex-valued networks rather than proposing new network architectures or learning algorithms. Furthermore, the two theoretical propositions rely primarily on established mathematical results; consequently, the originality regarding theory and methodology is relatively limited.
- Insufficient experimentation. The primary experiments utilize small-scale 1D CNNs and subsets of the RadioML dataset, while the EEG and quantum tasks rely mainly on synthetic data. The lack of validation on large-scale networks and across a broader range of real-world application scenarios makes it difficult to fully substantiate the paper's generalized conclusions.
- Uncertain generalizability of the SNR crossover phenomenon. Although the authors observed similar crossover phenomena across three experimental configurations, all were based on the same RF dataset. Without validation across diverse network architectures, datasets, and noise distributions, it remains unclear whether this phenomenon is universal.
- Minor question: The paper's structural layout is somewhat unusual—for instance, placing the "Related Work" section at the end—which differs from the official ICLR template.
Questions for authors
see above
2 comments
Official Comment by Reviewer sXoK
I thank the authors for their clarification regarding Question 1. Furthermore, I appreciate their acknowledgment of the limitations in the experiments and the issues with the writing. Given that Questions 2, 3, and 4 remain unaddressed, I am maintaining my score.
Thank you for recognizing the value of the evaluation controls and activation analysis. We agree that the paper should state its contribution and empirical scope more precisely.
We will also narrow the interpretation of the constrained-real experiment. It establishes that complex-linear kernels admit a real-coordinate implementation and provides evidence about one structured parameterization. The current readout difference and the absence of comparable alternative constraints prevent it from proving that U(1) symmetry causes the observed crossover.
Experimental scale and real-world coverage: We agree that small 1D CNNs on RadioML subsets, together with synthetic EEG and quantum tasks, do not support broad claims about large-scale CVNNs or real-world applications generally. RadioML is our real-data RF benchmark; the other domains are controlled diagnostic settings. We will clearly distinguish these roles and restrict conclusions to the tested models and data. The controls are useful because they show that the sign and size of a reported advantage can change within a fixed evaluation setting. They do not establish how every architecture or application behaves. We will state the missing larger-model and independent real-dataset validations as limitations rather than imply that the existing controls provide them.
Generalizability of the crossover: We agree that the crossover has not been shown to be universal. We will clarify that 2–6 dB brackets the observed sign change under shared-trial selection; it is not itself the interval in which complex models necessarily have an advantage. Additional analysis of existing independently selected runs supports a more qualified result. At −6/−2 dB, the complex-minus-polar gaps are +8.13/+7.36 pp for seven classes at length 128, +5.54/+7.04 pp for ten classes at length 128, and +12.36/+7.69 pp for seven classes at length 256. All three turn negative at 2 dB, placing their principal sign change between −2 and 2 dB under independent selection. The qualitative reversal therefore persists in these configurations, while the numerical crossover interval is selection-dependent. This strengthens the within-RadioML observation without extending it to untested datasets, architectures, or noise models.
Organization and related work: Thank you for flagging the organizational difficulty. We will bring the relevant prior work earlier, introduce the baseline and training comparisons together, and organize the results around the central evaluation questions. We will also check the manuscript against the venue’s formatting requirements. The revised discussion will connect the symmetry interpretation directly to prior co-domain symmetry work, including Singhal et al. (CVPR 2022).