- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SemanticAudio proposes a two-stage flow-matching framework that separates text-conditioned semantic planning from acoustic synthesis and enables training-free editing in a compact semantic space. Experiments on audio generation and editing benchmark show competitive generation quality and improved semantic alignment and editing performance.
Critical strengths
The paper proposes a two-stage framework comprising a semantic planner and an acoustic synthesizer. The framework performs audio generation in a high-level semantic space and enables training-free editing within that space. This is a relatively novel approach to audio generation.
Critical weaknesses
- As the authors acknowledge in Section 4.5, “The full two-stage system has greater total capacity than that single-module baseline; these results therefore do not isolate the effect of semantic planning from model size.” Further evidence is needed to justify the two-stage design.
- The existing comparisons do not sufficiently cover representative methods and relevant technical approaches, such as Make-An-Audio 2 and Stable Audio models.
- Among the aesthetic metrics, the main experiments report only CU and PQ, omitting CE and PC. Furthermore, the aesthetic evaluation does not cover the AudioCaps generation or editing tasks.
Reference: [1] Huang, Jiawei, et al. "Make-an-audio 2: Temporal-enhanced text-to-audio generation." arXiv preprint arXiv:2305.18474 (2023). [2] Evans, Zach, et al. "Stable audio 3." arXiv preprint arXiv:2605.17991 (2026).
Questions for authors
- The experimental results include “Ours (d=128, REPA),” but the paper does not clearly explain what REPA means or how it is implemented. In addition, Section 4.4.3 presents its results by referring to Table 7 in the appendix, which is not an ideal presentation choice.
- For the acoustic reconstruction evaluation, please report the same generation metrics used in the main experiments, such as CLAP, to help assess the model’s potential performance ceiling.
- Why does the TTA-Bench evaluation not follow the subjective evaluation protocol of the original benchmark paper? Moreover, the paper states, “Because this subset includes AudioCaps prompts, we do not interpret the aggregate score as a separate test of out-of-distribution generalization.” Given this limitation, what is the intended purpose of this experiment?
- Could the authors clarify the following statement: “since it uses 50 Synthesizer steps instead of 25, this comparison does not isolate REPA’s effect”?