- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SRAM, a spectral relation-aware framework for environmental sound deepfake detection (ESDD). The method builds on the Qwen3-Omni audio encoder and combines cross-layer trajectory refinement, sparse evidence pooling, spectrogram residual modeling, and structure-tensor-based geometric features. The paper also presents a systematic evaluation of 15 Audio Large Language Models (ALLMs) under zero-shot and supervised fine-tuning settings. Experiments on EnvSDD demonstrate strong detection performance across seen and unseen source datasets and generation models.
Critical strengths
-
The paper addresses an important and relatively underexplored problem in environmental sound deepfake detection, with particular emphasis on generalization to unseen domains and generators.
-
The systematic evaluation of 15 ALLMs provides useful empirical insights into the limitations of generative audio models for deepfake detection. The observation that an audio encoder with a simple classifier can outperform the full generative model is particularly interesting.
-
The proposed method achieves strong results on EnvSDD, especially under unseen source and generator conditions. The paper also includes component ablations, robustness evaluations, and additional analyses that help characterize the proposed framework.
Critical weaknesses
- The comparison with recent state-of-the-art ESDD methods is incomplete.
Although the paper compares SRAM with several representative discriminative and generative approaches, it does not include strong recent systems from the ESDD 2026 Challenge, particularly the top-performing challenge solutions. Given the relevance of these methods to environmental sound deepfake detection, a more comprehensive comparison would be valuable. While differences in datasets and evaluation protocols may prevent direct numerical comparisons, the authors should either evaluate representative challenge systems under a consistent protocol or explicitly discuss their relationship to SRAM. This would provide stronger evidence for the claimed state-of-the-art performance.
- The generalization evaluation is primarily limited to a single benchmark.
Although EnvSDD provides comprehensive combinations of seen and unseen source datasets and generators, all primary detection experiments are conducted within this benchmark and its predefined splits. Such evaluations demonstrate generalization under the EnvSDD protocol but do not fully establish robustness across independently constructed datasets with different collection procedures, synthesis systems, and acoustic characteristics. Evaluation on an additional external ESDD benchmark, such as Fakesound or other sound deepfake dataset, would substantially strengthen the generalization claims.
- The contribution of the proposed architectural components is not sufficiently isolated from the strong pretrained audio encoder.
The authors evaluate SRAM with several audio backbones, including Qwen2-Audio, Qwen2.5-Omni, Qwen3-Omni, and Gemma-3n, in Table 10. These results provide useful evidence of backbone generality. However, Figure 9 evaluates the Encoder + MLP baseline only with Qwen2-Audio and Qwen2.5-Omni, while the main SRAM model uses Qwen3-Omni. A directly matched Qwen3-Omni Encoder + MLP baseline is therefore missing. Furthermore, although Table 4 supports the effectiveness of the proposed components, the individual contributions of the structure-tensor branch and sparse pooling are relatively modest. A controlled comparison between a fine-tuned Qwen3-Omni encoder with a simple classifier and the complete SRAM framework would help clarify whether the additional architectural complexity is justified by substantial performance gains.
Questions for authors
- The comparison with recent state-of-the-art ESDD methods is incomplete.
Although the paper compares SRAM with several representative discriminative and generative approaches, it does not include strong recent systems from the ESDD 2026 Challenge, particularly the top-performing challenge solutions. Given the relevance of these methods to environmental sound deepfake detection, a more comprehensive comparison would be valuable. While differences in datasets and evaluation protocols may prevent direct numerical comparisons, the authors should either evaluate representative challenge systems under a consistent protocol or explicitly discuss their relationship to SRAM. This would provide stronger evidence for the claimed state-of-the-art performance.
- The generalization evaluation is primarily limited to a single benchmark.
Although EnvSDD provides comprehensive combinations of seen and unseen source datasets and generators, all primary detection experiments are conducted within this benchmark and its predefined splits. Such evaluations demonstrate generalization under the EnvSDD protocol but do not fully establish robustness across independently constructed datasets with different collection procedures, synthesis systems, and acoustic characteristics. Evaluation on an additional external ESDD benchmark, such as Fakesound or other sound deepfake dataset, would substantially strengthen the generalization claims.
- The contribution of the proposed architectural components is not sufficiently isolated from the strong pretrained audio encoder.
The authors evaluate SRAM with several audio backbones, including Qwen2-Audio, Qwen2.5-Omni, Qwen3-Omni, and Gemma-3n, in Table 10. These results provide useful evidence of backbone generality. However, Figure 9 evaluates the Encoder + MLP baseline only with Qwen2-Audio and Qwen2.5-Omni, while the main SRAM model uses Qwen3-Omni. A directly matched Qwen3-Omni Encoder + MLP baseline is therefore missing. Furthermore, although Table 4 supports the effectiveness of the proposed components, the individual contributions of the structure-tensor branch and sparse pooling are relatively modest. A controlled comparison between a fine-tuned Qwen3-Omni encoder with a simple classifier and the complete SRAM framework would help clarify whether the additional architectural complexity is justified by substantial performance gains.