- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates Singing Voice Enhancement (SVE) from a data-composition and generative modeling perspective. First, the authors train a discriminative baseline (Hybrid Demucs, denoted DISCSVE) across several speech-to-singing mixing ratios (3:1 to 1:3) and data volumes using public corpora. Second, they adapt a complex-STFT conditional flow-matching speech enhancer (FlowSE) to stereo 44.1 kHz singing audio (SVEET) and propose a degradation-adaptive multi-scale vector-field loss (SVEET-MS) that pools complex residuals along the frequency axis. Third, they analyze an implementation pitfall regarding mean vs. sum loss reduction under the Adam optimizer. The models are evaluated on a custom 78-clip synthetic singing benchmark, two speech enhancement test sets (DNS 2020 and EARS-WHAM), the real-world SingVERSE benchmark, and a 30-listener subjective listening test.
Critical strengths
None. While releasing data manifests and checkpoints is generally commendable in audio restoration research, the foundational premise of the paper is built on factual misrepresentations of prior work, flawed experimental protocols (such as selecting data recipes on the benchmark test set and omitting single-modality baselines), and unsubstantiated technical claims. Thus, no substantive strength supports acceptance.
Critical weaknesses
The manuscript reads heavily like an unreviewed, agent-generated draft containing factual hallucinations, methodological contradictions, and severe structural flaws. Specifically:
- Factual Misrepresentation of Prior Work Reduces the Core "Public-Data" Premise (Contribution 1):
- The paper repeatedly claims that existing SVE systems like AnyEnhance (Zhang et al., 2025) rely on "21,000 hours of proprietary audio" and "train on private studio stems" (e.g., Page 1, Lines 038–040). This is factually false. As explicitly documented in Table 2 of the original AnyEnhance paper, all studio singing voice and speech corpora used to train AnyEnhance are publicly available open-source datasets (Specifically: OpenSinger, PopCS, PopBuTFy, Opencpop, M4Singer, SingStyle111, and ACESinger for singing). Claiming that prior SOTA relies on "private studio stems" to propose a "first public-data design" narrative severely reduces the paper's primary data contribution.
- Framing a trivial PyTorch reduction bug (
meanvssum) as a key scientific contribution (Contribution 3):
- In the Introduction's third bulleted contribution (Page 2, Lines 063–067), Section 3.3 (Page 5, Lines 231–236), Conclusion (Page 9, Line 482), and Appendix D (Page 15), the authors claim to uncover a "loss-scale pitfall for added objectives." Section 3.3 reveals this arises from a simple implementation error: replacing the base per-example sum reduction with .mean() across all dimensions, shrinking gradients by F x T=65536 and pushing the second moment below Adam’s . Their gradient probe merely verifies a basic calculus identity. Proposing a basic coding mistake as a flagship ICLR contribution is unacceptable.
- Ineffectiveness of the Proposed Multi-Scale Objective (SVEET-MS) on Objective Metrics and Real-World Data (Contribution 2):
- On the custom synthetic singing benchmark (Page 7, Table 1), SVEET-MS actually degrades SI-SDR on Acapella (Noisy) compared to the vanilla SVEET baseline (10.94 dB vs. 11.55 dB). As admitted on Page 6 (Lines 329–338), the slight overall SI-SDR increase (35.10 vs. 34.71 dB) is entirely driven by high-variance clean pass-through clips, and both SI-SDR (+0.4 dB) and PESQ (+0.03) differences are statistically insignificant (95% bootstrap CIs include zero).
- On speech enhancement (Page 16, Table 7), SVEET-MS performs worse than vanilla SVEET across all four metrics (SI-SDR, PESQ, ESTOI, PQ) on DNS 2020, and degrades PQ on EARS-WHAM (6.25 vs. 6.34).
- On the real-world SingVERSE benchmark (Page 17, Table 9), SVEET-MS achieves lower PQ than vanilla SVEET (6.40 vs. 6.45). The authors explicitly admit that "the perceptual gain of the multi-scale objective on our synthetic noisy conditions does not carry over to these recordings". Furthermore, in the ablation study (Page 17, Table 8), gated multi-scale {1, 2, 4} causes SingVERSE PQ to collapse from 6.45 to 6.05. Finally, both SVEET (0.747) and SVEET-MS (0.758) severely degrade speaker similarity (SIM) on SingVERSE compared to the unprocessed noisy input (0.750) and baselines like HDemucs (0.834), indicating vocal timbre distortion.
- Flawed Experimental Design:
- Missing 0:1 and 1:0 Baselines in Ratio Sweeps: The paper claims to systematically study speech-to-singing ratios, yet only tests 3:1, 2:1, 1:1, 1:2, and 1:3, completely omitting speech-only (1:0) and singing-only (0:1) baselines. Without single-modality baselines, the benefit of mixing speech and singing cannot be established. Moreover, performance across the tested ratios is nearly flat (PESQ spread of 0.08).
- Omitting Reverberation in Training Despite Testing Dereverberation: The Introduction defines SVE as removing reverberation, and both noisy benchmark conditions include synthetic room convolutions and heavy reverberation. Yet the training recipes contain zero reverberation (Page 13, Equation 6), which the authors awkwardly excuse as testing "out-of-distribution generalization."
- Chaotic Evaluation Revisions: The exact same model (DISCSVE 1:1, 1000h) is reported with an Overall SI-SDR of 32.84 dB (15.29 dB on Singing w/ Acc Noisy) in Table 1 (Page 7), but 33.56 dB (17.78 dB on Singing w/ Acc Noisy) in Tables 12 and 13 (Page 18) due to inconsistent "earlier revisions" of the benchmark and pipeline (Page 6, Line 281).
- Unacceptable Presentation:
- The main text contains zero figures and only two tables (Table 1 and Table 2). Crucial empirical evidence central to the paper's claims—data composition sweeps (Tables 12–13), loss ablations (Table 8), speech generalization (Table 7), and SingVERSE evaluation (Table 9)—are all in the Appendix.
Questions for authors
- Regarding AnyEnhance's training data: Can the authors explain why AnyEnhance (Zhang et al., 2025) is repeatedly characterized as being trained on "proprietary audio" and "private studio stems," when Table 2 of Zhang et al. (2025) explicitly lists public open-source singing datasets (OpenSinger, PopCS, PopBuTFy, Opencpop, M4Singer, SingStyle111, ACESinger)?
- Regarding the missing single-modality baselines: Why were 0:1 (singing-only) and 1:0 (speech-only) configurations omitted from a study whose primary goal is to evaluate speech-to-singing data composition?
- Regarding the inconsistent training degradation recipes (Page 13, Lines 695–701): Why were M4Singer, OpenCPOP, SingStyle111, and VocalSet degraded with the light speech noise profile (single layer, [-30, -14] dB) while GTSinger was degraded with 1–4 layers at [-40, -2] dB, instead of regenerating all manifests under a unified protocol?
- Regarding the proposed Multi-Scale Loss and the "loss-scale pitfall": Why do the authors frame an implementation bug in their initial code (accidentally replacing
sumreduction withmeanreduction across all time-frequency bins, scaling the loss by 1/(F*T)) as a major scientific contribution? Furthermore, once this bug is fixed, SVEET-MS degrades SI-SDR on Acapella (Noisy) (10.94 vs. 11.55 dB in Table 1), underperforms vanilla SVEET across all metrics on DNS 2020 (Table 7), and yields lower PQ (6.40 vs. 6.45) on real-world SingVERSE recordings (Table 9). Given that the objective gains are statistically insignificant or negative on unseen real-world data, how can the effectiveness of the multi-scale objective be justified?