- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Atom-TTS, a lightweight TTS system consisting of a Cascaded Parameter Acoustic Predictor (CPAP) and a Frame-Driven WORLD vocoder (FD-WORLD). CPAP predicts WORLD acoustic parameters through a cascaded TCN architecture, while FD-WORLD replaces pulse-driven synthesis with frame-level spectral reconstruction. The experimental results show improvements in model size and inference efficiency while maintaining reasonable synthesis quality.
Critical strengths
- The paper focuses on a practical problem of lightweight TTS deployment, achieving a small model size and low inference latency.
- The paper provides useful ablation experiments on acoustic prediction and vocoder efficiency, with relatively detailed implementation and evaluation protocols.
Critical weaknesses
- The contributions seem more engineering-oriented. The acoustic parameter interface in Section 4.1 follows the existing WORLD representation. The frame-driven synthesis in Section 4.3 is also similar to Nercessian (2023) [A1], which already uses fixed-hop STFT/iSTFT synthesis with harmonic and noise excitation. While FD-WORLD clearly improves efficiency over the original WORLD, the paper does not sufficiently clarify what is new compared with existing frame-based WORLD synthesizers.
- The contribution of explicit conditional dependencies is not fully verified. Section 4.2 conditions MCEP and aperiodicity prediction on the predicted fundamental frequency and voicing. However, the cascade-versus-parallel comparison in Table 3 does not isolate the effect of this conditioning. The improvement may also come from the three-stage architecture itself.
- Insufficient support for some synthesis-quality claims. The subjective MOS results in Table 1 (Section 5.2) rank Atom-TTS above both sanoTTS variants, whereas UTMOS, SCOREQ, and DNS-OVRL in Table A6 consistently show the opposite ranking. The discussion in Appendix 11.3.2 does not fully explain this discrepancy. In addition, Section 5.4 concludes that FD-WORLD and WORLD are perceptually equivalent, although the switching task still detects audible differences.
- Formatting issues. The manuscript does not appear to fully follow the official ICLR 2027 formatting guidelines, particularly in the abstract and overall layout. The authors should check the formatting against the official ICLR template.
[A1] S. Nercessian, “Differentiable WORLD Synthesizer-Based Neural Vocoder With Application To End-To-End Audio Style Transfer,” in Proc. AES Convention 154, May 2023, Paper 10661.
Questions for authors
- How does FD-WORLD differ from the frame-based WORLD synthesizer in Nercessian (2023) [A1]? What is the main contribution beyond using fixed-frame synthesis?
- Could the authors remove the predicted F0 and voicing conditioning from the Spectral Encoder while keeping the three-stage CPAP architecture unchanged? This would help isolate the effect of the explicit conditional dependencies claimed in Section 4.2.
- Could the authors explain the opposite rankings between MOS in Table 1 and the automatic metrics in Table A6? Does the switching-detection result in Section 5.4 suggest that the perceptual equivalence claim should be qualified?
- Section 4.3 reports a frame duration of about 21 ms and a frame rate of 200 frames/s. However, the stated 512-sample Hann window at 16 kHz corresponds to 32 ms, and the 120-sample frame shift corresponds to approximately 133 frames/s. Please clarify these settings.
[A1] S. Nercessian, “Differentiable WORLD Synthesizer-Based Neural Vocoder With Application To End-To-End Audio Style Transfer,” in Proc. AES Convention 154, May 2023, Paper 10661.
4 comments
-
Thank you for pointing this out. Upon verification, we found that the 16 kHz label in Figure 1 was incorrect. The actual sampling rate for synthesis in Atom-TTS is 24 kHz; a 512-sample window corresponds to 21.33 ms, and a 120-sample frame shift corresponds to 5 ms (or 200 frames per second). We have corrected this in the figure. Additionally, for the automated evaluation metrics, all audio samples were resampled to 16 kHz to meet the input requirements of the evaluation models. This step was part of the pre-processing phase for evaluation, and the relevant code can be found in the supplementary materials.
-
We have uploaded the actual Atom-TTS inference deployment code to the supplementary materials for your review.
Ablation studies on F0 and V/UV
Regarding Question 2, we have conducted the requested ablation studies by removing F0 and the V/UV (voiced/unvoiced) flag. Additionally, we performed two further experiments—one retaining F0 while masking the V/UV flag, and another retaining the V/UV flag while masking F0—and compared these against a baseline model (d1) with identical parameter counts and configurations. The results of these experiments are provided in Appendix D. Our analysis indicates that removing either F0 or the V/UV flag does not have a particularly significant impact on MCD (Mel-Cepstral Distortion) predictions, though minor differences in detail can be observed. However, there is a noticeable effect on AP (Aperiodicity). Removing F0, the V/UV flag, or both, leads to a reduction in AP estimation accuracy.
Thank you for the response and for running the additional experiments. The comparison with Nercessian (2023) helps explain where the speedup comes from. I would still like the paper to be clearer about what FD-WORLD adds to earlier frame-based WORLD methods. The new F0 and voicing ablation also answers my question. The clearest benefit is in aperiodicity estimation, with little change in MCD.
Overall, the response addresses some of my initial concerns. But my remaining concerns about perceptual quality are similar to those raised by Reviewer WxTQ. The additional MOS analysis strengthens the listening-test results, but the disagreement with the automatic metrics remains unexplained. Listeners often reported no audible difference in the ABX test. The differences detected in the switching task leave me unconvinced that the two vocoders are perceptually equivalent. I therefore maintain my original rating of 2 (weak reject).
Thank you for your valuable suggestions. We will now respond to each of them:
It can be observed that the inference efficiency of [A1] is not superior to that of WORLD, and is, in fact, significantly lower than that of FD-WORLD. It should be noted that, although our implementation follows the methods and configurations described in the original paper, we cannot guarantee that this is the optimal implementation, as the authors have not made the source code publicly available. In terms of the computational complexity of excitation generation, let L be the total number of samples in the output audio and K be the number of harmonics. The synthesis complexity of FD-WORLD is O(L), whereas the synthesis complexity of [A1] is O(LK). This is because [A1] requires calculating and superimposing K harmonics at every sample point, while FD-WORLD only needs to accumulate the phase and generate an impulse at each point—a process that reduces both the actual number of operations and the amount of intermediate data.
Thank you for your valuable suggestions. Following your feedback, we have reorganized our experiments. While maintaining the three-stage architecture of the CPAP model, we have set the F0 and V/UV inputs to the final layer to zero and removed the conditional dependence of MCEP and AP on F0. We are currently conducting ablation training with this modified setup, ensuring that the total number of trainable parameters remains unchanged. The experiments are underway, and we will upload the results within this week.
UTMOS, SCOREQ, and DNSMOS are all learned quality prediction metrics rather than direct measurements of human perception. They rely on relationships between human ratings derived from specific datasets and evaluation protocols, rather than universal perceptual principles applicable to all listeners, all synthesis systems, and all real-world conditions. We believe this stems from a lack of generalization in the automated models employed. You may evaluate this yourself via our demo page—accessible by opening the
audio_demo/index.htmlfile (included in our supplementary materials) directly in your web browser. Furthermore, to demonstrate the authenticity of our MOS data, we have re-compiled the statistics and conducted additional analyses to substantiate the subjective quality advantages of our approach. |Comparision|Mean-diff. range| Atom wins|Ties|Atom loses| |---|---|---|---|---| |Atom - sanoTTS standard|+0.20~+1.53|199(66.3)|75(25.0%)|26(8.7%)| |Atom - sanoTTS tiny |+0.60~+1.73|235(78.3)|54(18.0%)|11(3.7%)|Regarding the claim of complete equivalence, we incorporated three options into our ABX test: X=A, X=B, and "indistinguishable." Out of a total of 832 trials, participants responded "indistinguishable" in 670 instances, accounting for 80.5% of the total. In the remaining 162 trials—where participants chose either X=A or X=B—they provided the correct answer 90 times, representing a success rate of 55.6%. As this accuracy rate is not significantly higher than what would be expected by chance, we conclude that FD-WORLD and WORLD are perceptually equivalent for all practical purposes. Naturally, these data do not definitively prove that FD-WORLD and WORLD are perfectly equivalent in terms of perception; consequently, we have refined our phrasing—rather than asserting complete equivalence, we now state that there are no significant perceptual differences between FD-WORLD and WORLD.