- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper propose MoLN, a parameter efficient finetuning method for speech deepfake detection (SDD). They first elaborate the necessity of using PEFT for robust and generalizable SDD, then argue that using LN-only finetuning is more effective than LoRA. They further introduce MoE-alike router with multiple LN expert jointly finetuned for better performance.
Critical strengths
The paper is clearly written and easy to follow.
The empirical evaluation is well-targeted and relevant to the central hypothesis.
Critical weaknesses
Concerns on the soundness of the experiments
The preliminary anlysis shows that the representation CKA before and after LoRA PEFT is smaller than LN. My concern is that is this affected largely by learning rate? Have you searched for the optimal configurations for both methods before comparing them?
Limited Significance and Narrow Scope.
While I acknowledge that the proposed method outperforms LoRA, I find the magnitude of the improvements relatively modest. Moreover, the scope of the work appears somewhat narrow, which further limits its potential impact. Overall, I am not fully convinced that the contributions are substantial enough to meet the expectations of a venue like ICLR.
Questions for authors
Please feel free to address the questions in the above weaknesses part.
Additional questions:
Why did you choose to train on ASV2019 rather than other datasets? Will switching to another corpus for training make any differences?
7 comments
Author Response (2/2): W2, Q1
W2: How significant are the improvements, and how broadly do they apply?
A2: Voice impersonation is a practical speech security problem. In 2024, an Arup employee in Hong Kong transferred approximately US$25 million after fraudsters impersonated executives using fabricated voices and images on a video call (Magramo, 2024). In 2026, Greek police reported that a fraud ring used AI-cloned voices to impersonate victims’ relatives over the phone (Karagiorgas, 2026). At deployment, in contrast to other fields, shifts in synthesis methods, codecs, and recording conditions can coincide with changes in spoken language (Yamagishi et al., 2021; Marek et al., 2025).
Under this scenario, we ask a question whether a compact adaptation of a pre-trained speech encoder can generalize across these shifts using only source-domain data for adaptation. Prior work on multimodal adaptation motivates LayerNorm as a compact interface for feature recalibration (Zhao et al., 2024). In Section 3.3, different attack and bandwidth conditions favor different local LayerNorm updates, and the top two directions explain 94.6% of the variation in those gradients. This finding motivates MoLN’s small bank of residual affine experts, which are mixed at each frame without domain labels or test-time parameter updates.
Experimental results show that the proposed method is effective. Across three seeds and six benchmarks, MoLN reduces mean EER from 13.62% to 12.90% relative to reproduced LoRA while using 75% fewer trainable parameters (0.90M vs. 3.59M). On In-the-Wild, EER drops from 10.43% to 7.17%. We also evaluate MoLN across encoder–detector architectures and five MLAAD languages, and routing interventions show that the learned frame-level weights contribute to detection performance.
We hope this work draws more attention to speech security and gives the community a parameter-efficient method for studying detection under domain shift.
Q1: Why did you train on ASVspoof 2019 LA, and do MoLN’s gains hold with a more diverse training corpus?
A1: We chose ASVspoof 2019 LA because it is a widely used training source for speech deepfake detection and enables comparisons with prior work. Its training split contains four text-to-speech and two voice-conversion attacks, providing variation in how spoofed speech is generated.
With this training source held fixed, we evaluated transfer across datasets that differ in synthesis methods, recording conditions, and compression. We also added a language-stratified evaluation across five MLAAD languages. MoLN achieves 94.69% macro-balanced accuracy with a threshold selected on the ASVspoof 2019 LA development set and applied unchanged across languages.
To test whether MoLN’s gains persist with a more diverse training corpus, we are retraining MoLN and key baselines on the larger ASVspoof 5 training split using the same set of training seeds. The multi-seed comparison is in progress, and we plan to report the results and analysis in a subsequent revision.
References
- Magramo, K. (2024, May 17). British engineering giant Arup revealed as $25 million deepfake scam victim. CNN Business.
- Karagiorgas, I. (2026, September 18). Greece: Police bust gang using AI to clone relatives’ voices for cash. Euronews.
- Marek, B., Kawa, P., & Syga, P. (2025). Are audio DeepFake detection models polyglots? In Proceedings of the 5th Symposium on Security and Privacy in Speech Communication (SPSC), pp. 48–55.
- Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., & Delgado, H. (2021). ASVspoof 2021: Accelerating progress in spoofed and deepfake speech detection. In Proceedings of the 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge, pp. 47–54.
- Zhao, B., Tu, H., Wei, C., Mei, J., & Xie, C. (2024). Tuning LayerNorm in Attention: Towards Efficient Multi-Modal LLM Finetuning. In Proceedings of the 12th International Conference on Learning Representations (ICLR).
Follow-up to Q1
Follow-up to Q1 — Effect of changing the training corpus
We chose ASVspoof 2019 LA for the main experiments to enable comparison with prior work under a common training protocol. To assess the effect of changing the source corpus, we trained MoLN and four baselines on the same speaker-matched, class-balanced 16,000-utterance subset of ASVspoof 5 and evaluated them on 21DF, In-the-Wild, and Fake-or-Real.
Across three training seeds, MoLN achieves the lowest mean EER on each external benchmark. Its three-benchmark average is 14.31 ± 2.39%, compared with 21.98 ± 2.99% for LN-Tune and 28.30 ± 10.79% for LoRA. On In-the-Wild, MoLN achieves 7.76% mean EER compared with 14.12% for LN-Tune. These results show that the relative gains persist when training on the ASVspoof 5 subset. The new Appendix J reports the full comparison and experimental protocol.
Author Response (1/2): W1
Thank you for raising questions about the fairness of the LN–LoRA comparison, the magnitude of the gains, and the choice of training corpus. We clarified the training settings used in the CKA analysis, added a comparison of LoRA training configurations, and expanded the evaluation across benchmarks, architectures, and languages.
W1: Training configurations selection.
A1: As detailed in Appendix D.2, LN tuning uses Adam with a learning rate of 10−4. For LoRA, we evaluated Adam and AdamW configurations at ranks 4, 8, and 16. The AdamW configuration in Table 2 uses a cyclic learning rate from 10−6 to 10−4. Prior LoRA studies also use AdamW with a cyclic schedule for XLSR-53–AASIST trained on ASVspoof 2019 LA (Laakkonen et al., 2025, 2026). This configuration achieves a lower ASVspoof 2021 DF EER at all three ranks tested with both optimizers.
LoRA training configurations on ASVspoof 2021 DF
On the same benchmark, Laakkonen et al. (2025) report 4.37% EER for rank-4 LoRA, and Laakkonen et al. (2026) report 4.35 ± 1.37% for rank-16 LoRA trained with empirical risk minimization. Under the reported training settings, LN tuning achieves higher CKA than LoRA at every rank in Table 2. The difference also holds for rank-4 LoRA, which achieves lower 21DF EER than LN tuning (2.82% vs. 3.75%), while LN tuning retains greater similarity to the pre-trained representation (CKA of 0.1406 vs. 0.0894).
References