- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AGDT, an audio deepfake detection framework that combines sensitive layer fusion, asymmetric dual-stage multi-scale temporal modeling, and attentive statistics pooling. Specifically, XLS-R representations are aggregated through layer-wise gating, followed by a gated multi-scale temporal convolution module (MSTCM), a Conformer encoder, and an ungated MSTCM. The model is trained on ASVspoof 2019 LA and evaluated on multiple cross-domain benchmarks, including ASVspoof 2021 LA/DF, ASVspoof 5, In-the-Wild, and other datasets.
Critical strengths
-
The paper addresses the important problem of generalization in audio deepfake detection, particularly under unseen synthesis methods, channel distortions, and cross-domain conditions.
-
The experimental evaluation covers a relatively broad range of datasets, including ASVspoof 5 and several out-of-domain benchmarks. The proposed method achieves competitive results on multiple evaluation sets.
-
The paper includes ablation studies on temporal module placement, convolution kernel configurations, and encoder architectures, providing useful empirical observations about different temporal modeling strategies.
Critical weaknesses
-
The methodological novelty is relatively limited. The proposed framework mainly combines existing components, including XLS-R sensitive layer fusion, multi-scale temporal convolutions, channel and temporal attention, a Conformer encoder, and attentive statistics pooling. The main novelty appears to lie in the asymmetric placement of gated and ungated convolution modules around the Conformer. However, this is largely an architectural combination of established techniques, and the paper does not sufficiently demonstrate a fundamentally new modeling mechanism.
-
The necessity of the asymmetric dual-stage design is not sufficiently justified. Although Table 3 compares different temporal module placements, it does not directly investigate whether the asymmetric gating strategy itself is responsible for the improvements. For example, comparisons between both-gated, both-ungated, and reversed-gating configurations are missing. Without these controls, it is difficult to determine whether the gains arise from the proposed asymmetric design or simply from introducing additional multi-scale convolution modules and model capacity.
-
The performance improvements over strong baselines are relatively limited, and the contribution of individual components remains unclear. In Table 1, the proposed method improves the best reported EER from 1.77% to 1.56% on ASVspoof 2021 DF and from 14.40% to 13.57% on ASVspoof 5, while performing substantially worse than several baselines on ASVspoof 2021 LA. Although improvements on some additional datasets are more noticeable, the overall advantage is not consistently demonstrated. Moreover, Table 3 indicates that data augmentation contributes substantially to cross-domain performance, particularly on In-the-Wild and ASVspoof 5. Given the strong XLS-R frontend and RawBoost augmentation, the additional benefits attributable specifically to the proposed architectural design require clearer analysis. Tables 1 and 2 also lack aggregate performance measures, and no multi-seed results or statistical variance are reported to establish the reliability of the improvements.
-
Several experimental configurations and ablation settings require clarification. In Table 3, the variant "w/o SLS" is not sufficiently explained. It is unclear whether removing SLS means using only the final XLS-R layer, averaging representations across layers, or adopting another feature aggregation strategy. This distinction is important for interpreting the contribution of layer fusion. The manuscript should also explicitly clarify whether the XLS-R frontend is frozen or fine-tuned during training and ensure that the comparisons use consistent training and augmentation protocols.
-
Some presentation and technical details should be improved. The abbreviation "ASP" is used in the ablation study without being explicitly introduced in its abbreviated form. Although attentive statistics pooling is described in the methodology, the terminology should be defined consistently. In addition, the paper would benefit from clearer reporting of model complexity, including total/trainable parameters and computational overhead introduced by the two MSTCM modules. Such information is important for evaluating whether the additional architectural complexity is justified by the observed performance gains.
Questions for authors
-
The methodological novelty is relatively limited. The proposed framework mainly combines existing components, including XLS-R sensitive layer fusion, multi-scale temporal convolutions, channel and temporal attention, a Conformer encoder, and attentive statistics pooling. The main novelty appears to lie in the asymmetric placement of gated and ungated convolution modules around the Conformer. However, this is largely an architectural combination of established techniques, and the paper does not sufficiently demonstrate a fundamentally new modeling mechanism.
-
The necessity of the asymmetric dual-stage design is not sufficiently justified. Although Table 3 compares different temporal module placements, it does not directly investigate whether the asymmetric gating strategy itself is responsible for the improvements. For example, comparisons between both-gated, both-ungated, and reversed-gating configurations are missing. Without these controls, it is difficult to determine whether the gains arise from the proposed asymmetric design or simply from introducing additional multi-scale convolution modules and model capacity.
-
The performance improvements over strong baselines are relatively limited, and the contribution of individual components remains unclear. In Table 1, the proposed method improves the best reported EER from 1.77% to 1.56% on ASVspoof 2021 DF and from 14.40% to 13.57% on ASVspoof 5, while performing substantially worse than several baselines on ASVspoof 2021 LA. Although improvements on some additional datasets are more noticeable, the overall advantage is not consistently demonstrated. Moreover, Table 3 indicates that data augmentation contributes substantially to cross-domain performance, particularly on In-the-Wild and ASVspoof 5. Given the strong XLS-R frontend and RawBoost augmentation, the additional benefits attributable specifically to the proposed architectural design require clearer analysis. Tables 1 and 2 also lack aggregate performance measures, and no multi-seed results or statistical variance are reported to establish the reliability of the improvements.
-
Several experimental configurations and ablation settings require clarification. In Table 3, the variant "w/o SLS" is not sufficiently explained. It is unclear whether removing SLS means using only the final XLS-R layer, averaging representations across layers, or adopting another feature aggregation strategy. This distinction is important for interpreting the contribution of layer fusion. The manuscript should also explicitly clarify whether the XLS-R frontend is frozen or fine-tuned during training and ensure that the comparisons use consistent training and augmentation protocols.
-
Some presentation and technical details should be improved. The abbreviation "ASP" is used in the ablation study without being explicitly introduced in its abbreviated form. Although attentive statistics pooling is described in the methodology, the terminology should be defined consistently. In addition, the paper would benefit from clearer reporting of model complexity, including total/trainable parameters and computational overhead introduced by the two MSTCM modules. Such information is important for evaluating whether the additional architectural complexity is justified by the observed performance gains.