- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies reference-conditioned singing lyric editing (including edits that change syllable counts) while preserving the reference melody and singer timbre. It proposes CLASVS, a continuous-latent autoregressive model with learned stopping. For the architecture, it uses State-Control-Transition (SCT) routing: the planner takes target lyrics and reference melody as input and gets semantic summaries of generated latent patches as feedback, while a local flow-matching generator handles the acoustic generation using the previous acoustic patch. For training, it uses Progressive State-Control Grounding (PSCG), which combines semantic pretraining, control perturbations, and staged training without needing paired lyric-edit data or score annotations. On two Mandarin benchmarks across four edit operations, the model outperforms Vevo2 across the board and beats YingMusic+ on deletion and insertion (but YingMusic+ is still stronger on substitution). The authors also include objective metrics for melody and singer preservation, listening tests, and ablation studies.
Critical strengths
- Gains in length-changing lyric editing (deletion and insertion). CLASVS outperforms YingMusic+ on deletion and insertion across both Mandarin benchmarks, and also wins the A/B listening tests on naturalness and lyric intelligibility (Table 2, Fig. 3). This matters because insertion and deletion are usually the hardest parts of singing lyric editing—changing syllable counts easily breaks the melody or causes artifacts. Seeing consistent gains in both objective editing metrics and human listening tests shows the method actually works well in practice for variable-length edits.
- Thorough and well-controlled ablations. The authors do a good job isolating the effects of their routing and training designs (Table 3, Appendix A, Table 10). Specifically, the local vs. global acoustic access comparison keeps the rest of the model and training setups fixed, and the ablations account for the extra training budget from semantic pretraining, alongside checks on multiple seeds, freezing, perturbations, and stage ordering.
Critical weaknesses
-
Limited novelty over related continuous-AR models. The core idea of SCT (feeding semantic summaries back into the LLM + a separate flow head for acoustics) was already used in prior work like dots.tts. While CLASVS adds melody conditioning and limits the flow head's history to the preceding patch, the paper does not clearly separate what is actually new here from existing architectures.
-
PSCG is mostly a combination of well-known tricks (semantic pretraining, freezing, input perturbations, and staged training). Also, the routing ablation in Table 10 only tests whether raw acoustic history should go into the planner, without testing the effect of limiting the flow head to just one preceding patch.
Questions for authors
-
Could the authors clarify what they consider the main methodological contributions of SCT and PSCG beyond this prior work(e.g. dots.tts)? Also, since Table 10 only tests acoustic input to the planner, do you have a matched comparison of one-patch vs. longer acoustic history inside Flow-DiT with all other settings fixed?
-
In State Grounding, the feedback encoder is pretrained with both CTC and Mel reconstruction. Why include Mel reconstruction if the goal is semantic/phonetic progress tracking? Is there a comparison with CTC-only pretraining under a matched budget?
-
What singing genres and syllable rates are covered in the benchmarks, and do the deletion/insertion gains hold for fast singing or rap-like vocals? Using the existing evaluation outputs, could you also show how lyric accuracy and melody preservation vary with the percentage of syllables added or deleted?
-
Why choose a 100 ms patch size? Has its impact on editing accuracy been compared against shorter patches (especially for dense lyrics or fast articulation) to see the trade-off between feedback frequency and generation cost?