- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses output-length determination in non-autoregressive speech-to-speech translation. The authors argue that masked diffusion and discrete flow models fill a canvas whose size must be fixed before decoding, whereas translation length varies across utterances, and that existing NAR S2ST systems therefore rely on an external length predictor, parallel decoding of candidate lengths, or the source length. Rather than proposing a new method, the paper adapts existing variable-length generation techniques to S2ST within the UnitY two-pass layout, varying only the text decoder while sharing the speech encoder, text-to-unit model and vocoder. Two settings are studied: LLaDA-8B-Base attached to the speech encoder through a projector and LoRA, decoded on a fixed EOS-padded canvas or extended with FlexMDM and DreamOn; and a small DiT decoder trained from scratch with Branching Flows, which starts from a single masked element and reaches its length through splits and deletions. On CVSS-C French–English, the LLaDA-based systems reach 28.10, 29.15 and 29.86 ASR-BLEU. Branching Flows reaches 24.19 with a dev-tuned split multiplier, slightly above Dub-S2ST 23.35 and S2UT 23.54 but below the autoregressive UnitY 25.39.
Critical strengths
Output length is a known difficulty for canvas-based NAR decoders, and the paper compares several recent variable-length mechanisms on S2ST within a shared pipeline: the same speech encoder initialisation, text-to-unit model, vocoder and ASR scorer, with a continued-training control for the extra epoch given to the extensions. Deviations from the original recipes and the decoding behaviour of each system are documented in detail, and applying Branching Flows to translation is new.
Critical weaknesses
-
In Table 1, the LLaDA row is decoded without an EOS rule and returns 1,060 empty texts, a failure mode for which the LLaDA authors give a remedy. With a similar rule in Table 4 Appendix D, the same model before the extra epoch reaches 34.38 text BLEU, above FlexMDM 32.51 and DreamOn 33.49 after the extra epoch. The extensions, meanwhile, use their own decode-time choices; DreamOn, for instance, exhausts its 64-expansion cap on 53% of test utterances in Appendix B.3, so it is unclear how much of its length decision comes from the expansion mechanism rather than the separately trained count head.
-
Branching Flows is compared with Dub-S2ST, but the two differ in more than how length is decided. Branching Flows writes intermediate text and uses a text-supervised UnitY encoder, UnitY piece embeddings and an auxiliary AR loss, whereas Dub-S2ST is textless with its length tied to the source. Its margin over Dub-S2ST (24.19 vs. 23.35) also depends on the dev-tuned multiplier (22.94 at m = 1.0). The result therefore says little about the length mechanism itself.
Questions for authors
Please address the concern raised under Critical Weaknesses.
2 comments
Thank you for the candid and thorough response. I really appreciate the additional controls, and the revised tables and conclusion make the comparisons much fairer and the paper clearly stronger. With these corrections, though, the advantage of the variable-length mechanisms over the fixed canvas with an EOS rule and the like-for-like baselines seems less clear to me than in the submission. On balance I'm keeping my rating at 2 for now.
We thank the reviewer for the review. The goal of this paper is to study how variable-length methods built for other domains, such as code infilling and molecule generation, can be adapted to speech translation, where the length of the translation must be decided from the speech, and how well they perform, rather than to propose a new architecture.
W1)
W2)