- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Tacit-TTS, an efficient transcript-free zero-shot voice cloning system distilled from IndexTTS2. The method replaces autoregressive text-to-semantic decoding with masked non-autoregressive generation, estimates output length from acoustic speaking-rate cues and target-text syllable counts, and accelerates the semantic-to-Mel renderer through ReFlow distillation. Experiments on English and Mandarin benchmarks demonstrate a favorable trade-off between generation speed and synthesis quality. Additional evaluations examine cross-lingual and non-lexical reference audio.
Critical strengths
-
Clear practical motivation: Improving inference efficiency while retaining transcript-free reference conditioning addresses a useful deployment setting, particularly when reliable reference transcripts are unavailable.
-
Promising empirical trade-off: The system substantially reduces generation latency while maintaining competitive intelligibility and speaker similarity. English speaker similarity is particularly strong, although content accuracy remains below the teacher.
-
Relevant evaluation settings: The standard benchmarks are complemented by cross-lingual and non-lexical reference experiments.
Critical weaknesses
-
The methodological novelty appears limited: The method combines established techniques and inherits transcript-free conditioning from IndexTTS2. The integration is effective, but the distinct methodological contribution could be clearer.
-
The main text provides insufficient component-level ablations: The main text does not isolate the benefits of residual recovery, acoustic length estimation, or ReFlow. This makes it difficult to assess how much each component contributes to the final speed–quality trade-off.
-
Baseline inference settings need clarification: Although timing is conducted on the same GPU, the inference frameworks and optimization settings are not specified. These details are particularly relevant for AR baselines, whose decoding speed can depend substantially on the inference implementation, and would help establish the comparability of the speed measurements.
Questions for authors
-
Could the authors provide component ablations comparing discrete-only distillation with residual recovery, and the renderer before and after ReFlow at the same sampling budget?
-
How does the acoustic length estimator compare with a fixed tokens-per-syllable baseline, particularly in content accuracy and adaptation to the reference speaking rate?
Response to Reviewer JLKC
Thank you for the clear summary, and for recognizing the practical motivation, the favorable speed–quality trade-off, and the relevance of our evaluation settings. We address your concerns point-by-point below.
W1. Limited methodological novelty.
A: Thank you for recognizing the practical motivation. Our contribution is a systematic redesign of a strong AR system into a NAR one that is fast, transcript-free, and needs no user-specified duration. This required solving two problems that do not arise in the AR setting: fixing the output length without a reference transcript, which our training-free length estimator addresses, and driving the teacher's continuous-latent renderer from discrete NAR outputs, which residual recovery addresses (dropping it raises WER/CER by 18–50% relative). The result combines the strengths of both families:
W2. Insufficient component-level ablations in the main text.
A: Thank you for this suggestion. We ran all three ablations (global response Q1 and Q3) and have added them to Appendix H of the revised submission; we will move the key table into the main text in the final version.
W3. Inference settings of the baselines in the timing comparison are not specified.
A: Thank you for pointing this out. All baselines were timed with their official implementations and default settings on the same A100 GPU. For IndexTTS2, we used the speed-up options supported by its official implementation: KV caching (enabled by default), fp16, and
num_beams = 1instead of the default 3. These choices favor the teacher's speed. Even so, the AR decoder needs one forward pass per generated token, whereas our NAR decoder uses a fixed 12 forward passes regardless of output length.Q1. Discrete-only vs. residual distillation, and the renderer before vs. after ReFlow at the same budget.
A: As described in our global response Q1:
Q2. The length estimator vs. a fixed tokens-per-syllable baseline, in content accuracy and rate adaptation.
A: As shown in our global response Q3:
On LibriSpeech, our output follows about three quarters of the natural dependence (0.27 vs. 0.37), and it follows more weakly on SeedTTS-en. On Mandarin, it barely follows the reference rate, because most Mandarin references are slower than the estimator's upper bound (12 codes/syllable) and are capped there. The bound is needed because the NAR student fills an overly long target with repeated content (global response Q3).
We will present the estimator as a simple transcript-free length prior with partial pace transfer in the final version.