- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a generative sound masking method that generates synthetic background-mask training pairs using guided audio diffusion, filters them using automated LLM and audio-classifier checks, and trains a causal autoregressive diffusion model (distilled with Easy Consistency Tuning) to generate natural sounds that mask unwanted background noise.
Critical strengths
None
Critical weaknesses
-
This paper is essentially a contrived alternative to standard audio source separation and noise suppression, and it fails to compare against proper state-of-the-art separation baselines such as TF-GridNet [A] and TF-Locoformer [B]. Without comparing against these models, the proposed setup reads like a gimmick with little practical value: the authors claim to predict a causal mask for future background sounds, but their online model is simply acting as a causal sequence predictor with lookahead, which a standard state-of-the-art causal separation model [A, B] can do directly and much more effectively. Furthermore, the authors normalize and decode the results of their so-called online causal algorithm in a non-causal way across the entire clip during evaluation.
-
As shown in Section 3.4 and Section 5.3, the experimental setup is circular and lacks human evaluation: the authors filter and annotate their training data using LLMs and audio classifiers, and then evaluate their model on the exact same LLM and classifier labels without including any human listening study.
[A] Wang, Z.Q., Cornell, S., Choi, S., Lee, Y., Kim, B.Y. and Watanabe, S., 2023. TF-GridNet: Integrating full- and sub-band modeling for speech separation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31, pp. 3221-3236.
[B] Saijo, K., Wichern, G., Cornell, S., Germain, F.G., Khurana, S. and Le Roux, J., 2024, September. TF-Locoformer: Transformer with local modeling by convolution for speech separation and enhancement. In 2024 18th International Workshop on Acoustic Signal Enhancement (IWAENC) (pp. 205-209). IEEE.
Questions for authors
Why should one use a generative model to add synthetic noise on top of background noise instead of using a state-of-the-art causal source separation or enhancement model such as TF-GridNet [A] or TF-Locoformer [B], and how do they compare in a human listening study?