- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes XLSR-EMA, a speech deepfake detection framework designed to detect speech generated by modern Audio Language Models (ALMs) and codec-based generative models, whose forgery artifacts are distributed across multiple acoustic and semantic levels. The framework consists of three stages. Stage A applies a Dual-Purpose Perceptual Augmentation (DPPA) strategy that adds continuous-scale noise to the raw waveform, aiming to improve robustness to channel degradation while enhancing sensitivity to subtle synthetic artifacts. Stage B constructs a joint forgery manifold by preserving the hidden representations of all layers of a frozen pre-trained XLS-R backbone, and stacking them into a unified Time-Layer-Feature representation, so that both low-level acoustic cues and high-level semantic cues are retained. Stage C applies an Efficient Multi-scale Attention (EMA) classifier that models interactions across temporal, layer, and feature dimensions through a tri-branch structure and outputs the real/fake decision. The method is evaluated on the Codecfake, ASVspoof 2021 DF, and In-The-Wild benchmarks, reporting 4.64% EER on Codecfake and 1.24% EER on ASVspoof 2021 DF, and the lowest EER in cross-dataset transfer settings. The experiments suggest the proposed framework is effective for detecting codec-based and ALM-generated speech.
Critical strengths
- The paper targets detection of codec/ALM-generated speech, which is a known weakness of existing detectors, and reports competitive results across multiple benchmarks, including robustness on lossy-codec conditions in ASVspoof 2021 DF.
- In the cross-dataset evaluation (Table 3), where all methods are trained on the same single source, XLSR-EMA reports the lowest EER in all four transfer settings, supporting the claim that preserving the full SSL representation helps transfer to unseen ALM/codec forgeries.
Critical weaknesses
- EMA is adopted from Ouyang et al. (2023) with limited modification, while DPPA is SNR-scheduled additive noise overlapping with existing augmentations. The main novelty—using all SSL layers—is insufficiently analyzed. Removing DPPA only slightly increases EER: 4.64→4.86 on Codecfake and 1.24→1.32 on 21DF.
- “Ours + Add. Data” uses additional Codecfake-mini data, while baseline training data are unspecified, potentially confounding the Codecfake gains. Codecfake-mini comes from the training split, but generator or codec overlap with the evaluation split is not discussed.
- Results lack run-to-run variance or statistical tests; min t-DCF is designated a primary metric but omitted; and the computational overhead of using 24 layers is unreported. The choice of g=2 also appears test-driven, with no held-out validation reported.
Questions for authors
- What training data did each baseline in Table 2 use? If the baselines were trained only on ASVspoof 2019 LA while XLSR-EMA additionally used Codecfake-mini, can you provide a comparison where all methods (including XLSR-EMA) are trained on exactly the same data?
- Codecfake-mini is drawn from the Codecfake training split and evaluation is on the Codecfake eval split. Do these splits share generators, speakers, or codec configurations? If so, how can the Codecfake result be considered independent of in-domain overlap?
- What concrete modifications did you make to the EMA module (Ouyang et al., 2023) beyond treating layers as channels and using a 4D input? Please point to the specific architectural differences.
- Is there quantitative evidence that high-SNR DPPA noise amplifies codec quantization artifacts specifically, rather than acting as generic regularization? The w/o-DPPA ablation shows a small gain (0.22 and 0.08 EER) — how do you interpret this?