- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper adapts a frozen, pop-oriented zero-shot SVS model (SoulX-Singer) to Peking Opera using 7.58 h of adaptation data. The frozen model produces a prompt-conditioned mel-spectrogram. Frames belonging to characters that a lexicon tags as Jian, Tuan or Shang-kou-zi are masked out.
A separately trained 143M-parameter flow-matching decoder then regenerates the full mel from the masked prior. The decoder is conditioned on Standard-Mandarin pinyin. Two training tricks are added:
- Stochastic routing. With probability 0.5 the target is the opera ground truth with TPM on; otherwise the target is
Mel_popitself with TPM off. - Region-aware weighting. The flow-matching loss weights masked frames 5x.
The authors also build a Pinyin-syllable Peking Opera ASR model (fine-tuned Qwen3-ASR-0.6B) and use it to compute PER.
Critical strengths
- Well-motivated, under-served problem.
- Expert listeners. 15 raters with professional Peking Opera experience, blinded and randomized presentation, and the interface is shown.
- Practical, cheap adaptation. The foundation model is untouched and priors are cached, so adaptation costs about 6 h on 8 GPUs
Critical weaknesses
- No demo page. It becomes very hard to judge the model based on numbers alone.
- The ablations do not isolate where the gains come from. Every variant in Table 2 keeps a 143M opera-trained decoder that regenerates the full spectrogram. Gains in AQ, OF and even TS could therefore come mainly from a generic opera-domain post-net or enhancer trained for 300k steps, not from phonology-aware masking or TPM. Two missing controls:
- (a) Same decoder, no category information at all: no TPM and either no mask or a random mask with the same masked-frame ratio.
- (b) An inference-time "all labels = Standard" condition evaluated quantitatively. Appendix E.2 shows only a single spectrogram.
Questions for authors
- Please report WavLM SIM (with CIs) for SoulX-Singer and ZeroOpera under both prompt conditions at matched target F0, overall and restricted to masked frames.
3 comments
I thank the authors for their uploading the demo page and providing additional controls, and I have improved my ratings based on the revisions. 1 question remains: In my listening to the provided demos, ZeroOpera sounds broadly comparable to SoulX-Singer in overall perceptual quality, and the audible advantage is not clear to me. Appreicate your explanation.
Clarifying the audible differences from SoulX-Singer
Thank you for updating your assessment and for taking the time to listen to our demos.
The main improvement we would like to clarify is opera-specific pronunciation. A syllable can sound clear and remain understandable while using a Mandarin pronunciation instead of the required Peking Opera pronunciation. SoulX-Singer already follows the melody well; ZeroOpera builds on this strength to improve these pronunciation details while preserving prompt timbre.
For example, Appendix A.1 illustrates “箭” pronounced as zian rather than jian, and “白” as bo rather than bai. To hear the relevant differences in the demos, the highlighted syllables can be compared across the ground-truth recording, SoulX-Singer, and ZeroOpera. Appendix E.3, Figure 7 also shows the system comparison, including melodic contours and ASR-recognized pronunciations.
We tested pronunciation correctness directly with three Peking Opera practitioners in a blinded evaluation under opera prompts. The results below were already reported in Section 5 (“Independent rule correctness”) of our response to Reviewer 9o1p. Of 197 syllable tokens, 11 uncertain cases were excluded, leaving 186.
| Category | Frozen SoulX-Singer | ZeroOpera |
|---|---|---|
| Jian | 12% | 85.2% (115/135) |
| Tuan | 15% | 88.0% (103/117) |
| Shang-kou | 8% | 82.0% (251/306) |
Each eligible syllable received three expert judgments. Percentages show the proportion of judgments rated correct; parentheses give correct/total judgments. SoulX-Singer percentages are rounded as previously reported.
We also measured overall listening quality separately. In Table 1, 15 listeners with professional Peking Opera experience gave higher average scores under unseen pop-singer prompts: Audio Quality increased from 3.23 to 3.57, and Opera Flavor from 3.22 to 3.61. This supports an average improvement, while allowing that individual demo excerpts may sound comparable.
We release an anonymous repo!
To enhance the credibility of our work, we have made our inference code and model weights publicly available via an anonymous link: https://anonymous.4open.science/r/ZeroOpera-7E5E/. We hope this gesture fosters a more favorable impression of our work.