- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LOFT, a lightweight framework for improving low-SNR automatic modulation recognition while keeping the pretrained model frozen. It trains a residual feature adapter using an optimal-transport-inspired prototype alignment loss and a classification loss, with high-SNR class prototypes serving as reference targets and batch-level prediction entropy determining the correction state during inference. Experiments on two RadioML datasets across six backbones report improved recognition accuracy with modest additional parameters and training cost.
Critical strengths
- Consistent accuracy gains across six backbones on two RadioML datasets support the method’s applicability across different AMR architectures.
- The lightweight adapter requires only three training epochs while keeping the pretrained model frozen, offering an efficient way to improve existing models.
- Viewing low-SNR recognition as a latent feature recovery problem offers a fresh perspective and enables targeted improvements in noise robustness.
Critical weaknesses
- The theoretical analysis controls a Wasserstein upper bound through class-mean regression, but does not establish that optimization brings corrected features closer to the full clean distribution.
- Evaluation is limited to datasets with relatively few modulation classes, leaving performance on richer modulation sets, such as RML2018.01A and HisarMod2019.1, unclear.
Questions for authors
- Does LOFT empirically reduce the Wasserstein distance to the clean feature distribution, and how large is the residual dispersion term in the theoretical bound?
- How does LOFT perform on datasets with more diverse modulation classes, such as RML2018.01A and HisarMod2019.1?
Response to Reviewer RZvY: Theoretical Validation and Generalization to Diverse Modulation Benchmarks
Thank you for your thoughtful feedback! We appreciate your positive assessment of our novelty, writing quality, efficiency, and generality. We have carefully addressed the concerns raised.
We empirically verify that LOFT reduces the class-conditional Wasserstein discrepancy to clean reference features by 28.55%. We also quantify the residual dispersion term in Theorem 1 and demonstrate a 23.90% reduction in the theoretical upper bound.
1. Wasserstein distance reduction. We compute empirical W2 using exact discrete OT (unregularized EMD with squared Euclidean cost) [1] on RML2016.10A. Each evaluation uses 128 low-SNR test features and 128 high-SNR (≥10 dB) clean reference features.
AWNLOFT reduces the mean empirical W2 by 28.55%, improving 10/11 classes. The sole exception is AM-SSB, consistent with the shortcut-dominance phenomenon illustrated in Fig. 1: the frozen backbone tends to misclassify samples from other modulation classes as AM-SSB, causing their representations to collapse toward the AM-SSB feature region. By mitigating this prediction bias, LOFT redistributes the collapsed representations toward their correct class-conditional clean distributions, improving overall alignment.
2. Residual dispersion and Theorem 1 upper bound. From Theorem 1 (Eq. 24),
\leq \sqrt{\mathbb{E}\||z+v_\phi(z,0)-\mu_y\||_2^2} + \sqrt{\operatorname{Tr}(\Sigma_y)}.$$ The first term measures the adapter-dependent discrepancy from the clean class prototype, while the second quantifies intrinsic clean-feature dispersion. We estimate both terms using 4,000 high-SNR clean training features per class. | Bound Component | Backbone | + LOFT | Rel. Change | |:---|---:|---:|---:| | Adapter-dependent term | 33.93 | **23.24** | **-31.51%** | | Residual $\sqrt{\operatorname{Tr}(\Sigma_y)}$ | 10.81 | 10.81 | - | | **Total Upper Bound** | **44.74** | **34.05** | **-23.90%** | The residual term is computed as $\sqrt{\operatorname{Tr}(\Sigma_y)}=\sqrt{\frac{1}{N_y}\sum_i\|z_i^{\mathrm{clean}}-\mu_y\|_2^2}$. Its class-averaged value is **10.81**. It remains unchanged because both methods share the same clean reference distribution. The adapter-dependent term contributes **75.8%** of the original upper bound and decreases by **31.51%** after LOFT, tightening the mean bound by **23.90%**. The bound reduction (**10.69**) is comparable to the empirical $W_2$ decrease (**10.11**), providing consistent theoretical and empirical evidence of improved feature alignment. Together, these findings support the theoretical interpretation of LOFT as a feature transformation that reduces the distributional discrepancy. > **[W2&Q2] Generalization to More Diverse Datasets.** To address this concern, we conducted six additional evaluations on the RML2018.01A [2] and HisarMod2019.1 [3] datasets, covering 24 and 26 modulation classes, respectively, and using 1024-length sequences. **1. Consistent improvements.** We evaluate LOFT on three architecturally distinct backbones (AWN, GRU2, and PETCGDNN). In all experiments, we keep the pretrained backbone frozen and train only the lightweight LOFT adapter for 5 epochs. | Backbone | RML2018.01A | Abs. Gain | HisarMod2019.1 | Abs. Gain | | :--- | :---: | :---: | :---: | :---: | | `AWN` (Base / **+LOFT**) | 61.86% / **62.35%** | **+0.49%** | 60.31% / **61.54%** | **+1.23%** | | `GRU2` (Base / **+LOFT**) | 63.72% / **64.27%** | **+0.55%** | 65.12% / **66.03%** | **+0.91%** | | `PETCGDNN` (Base / **+LOFT**) | 61.94% / **62.55%** | **+0.61%** | 59.81% / **60.76%** | **+0.95%** | LOFT improves accuracy in all six backbone–dataset combinations, with absolute gains of 0.49 to 1.23 percentage points. These results support LOFT's adaptability to larger class sets and 8× longer sequences with frozen backbones. **2. SNR-dependent gains.** On HisarMod2019.1, backbones reach 40% accuracy at −20 dB, indicating usable features; LOFT adds 0.91–1.23 pp overall. On RML2018.01A, −20 dB accuracy is near chance (4.17%), limiting recoverable information. Yet LOFT improves overall accuracy by 0.49–0.61 pp, suggesting benefits where discriminative features remain. **Revision:** We will update Section 5 and Appendix D.5 to present these results. **References:** [1] G. Peyré and M. Cuturi, “Computational Optimal Transport,” *Foundations and Trends in Machine Learning*, 2019. [2] T. J. O’Shea et al., “Over-the-Air Deep Learning Based Radio Signal Classification,” *IEEE JSTSP*, 2018. [3] K. Tekbıyık et al., “Robust and Fast Automatic Modulation Classification with CNN under Multipath Fading Channels,” in *VTC2020-Spring*, 2020.