- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes Reference-Structured Corruption (RSC), a training-free method for generating variations of a sound effect from a single reference. It divides the reference audio latent into temporal regions and assigns different corruption levels according to each region’s activity, allowing some parts to change more than others. The method is evaluated on Woosh and Stable Audio 3 using objective metrics, comparisons with existing methods, ablation studies, and a small human evaluation. Results show increased variation while maintaining similar generation quality, although the trade-off between diversity and preservation remains, and the method requires adapting the pretrained flow models to support different corruption levels across time.
Critical strengths
-
The main strength is that the method uses the structure of the reference audio to decide where to introduce more variation, rather than applying the same corruption level across the whole clip. This is a simple and useful idea for generating sound effects that remain recognizable but are not identical.
-
The authors test the method on two different flow models and include ablations and a human evaluation. The results show increased diversity with relatively small changes in generation quality, suggesting that the approach is not limited to a single backbone.
Critical weaknesses
-
The improvement in diversity is relatively modest, and the trade-off with reference preservation is still present. On Woosh, WCIS increases from 1.29 to 1.41, while identity drift also increases. The results do not clearly show that the method produces substantially better variations than existing approaches.
-
The human evaluation is limited to 7 reference sounds and 15 participants. The results show a trade-off between diversity and identity preservation, but the study is too small to establish that the method consistently produces useful variations across different types of sound effects. In addition, the method requires adapting the pretrained flow model to handle asynchronous corruption, so it is not entirely training-free in practice.
Questions for authors
-
Can the authors clarify how much of the improvement comes from the activity-based allocation itself, compared with simply using different corruption levels across temporal regions?
-
In the human evaluation, the method does not consistently improve both diversity and identity preservation. Do the authors have results on more reference sounds that show whether this trade-off holds across different types of SFX?
4 comments
COMMENT 2/2: Q&A
Q1) How much of the improvement comes from the activity-based allocation itself. We add a corruption variant of RSC derived from the relative activity corruption, which means it relies on the content-aligned chunking but with random flow times applied to each chunk. We compare in Fig.5, on matching flow-time intervals, how many generated variations of RSC and of each corruption method fall closer to the Production SFX ground truth, in the identity-diversity plane (-precision (Alaa et al., 2022)). Against content-aligned with random , and at restricted high corruption flow field intervals, RSC outperforms 4 out of 7 intervals on woosh and 5 of them on SAO3.
Q2) Human evaluation limitation. We agree that the limited number of references and participants is insufficient to establish clear production usefulness. We now explicitly acknowledge this limitation in the main paper and provide a thorough description of the evaluation protocol and its limitations in the appendix, including the wide confidence intervals, differences in stimulus formats, and inconsistent interpretations of the scoring instructions. We report these results transparently rather than claiming conclusive perceptual improvements, and highlight the need for larger and more reliable listening studies.
Evaluation and comparison of method on public dataset FSD50K. To answer the lack of reproducibility and open-source, we introduce a new ablation as a stratified evaluation on a subset of the FSD50K (CC-BY-NC). We evaluate each method's ability to generate variations across different categories (following the UCS-SFX ontology). We report results in Tab.10-11 and Fig.6. For fairness and comparison, we add 3 baselines to Tab.1 and Fig. 4, where we set up a shared protocol: the same 1,500 references, 10 variations each. Qwen3-Omni-Captioner describes each reference, and Qwen3-Omni-Instruct condenses the description into one 35-45 word sentence. From this caption, we generate with (i) Woosh text-to-audio, (ii) Stable Audio 3 small-sfx text-to-audio, and (iii) Stable Audio 3 small-sfx from the reference audio (default method init noise level of 0.9) with the prompt "create a variation of this sample that is ⟨caption⟩". RSC outperforms all three in quality (, , FAD) and identity ( vs. at most ). The baselines come closer to Production SFX diversity, but their variations no longer match the reference. We add new citations and clarify the open-source status of the SFX high-quality generation methods in the Related Works section.
Gentle Reminder: revised version and replies
Dear Reviewer ikrZ, thank you again for the supportive review. As the discussion period closes on 18 November, we kindly remind you that the revised version of the paper is uploaded. We suggest starting with the new Fig. 5 (Sec. 4.2).
D1) Modest diversity gain. After harmonising the protocol, the WCIS gain at no longer holds (Tab. 2); since production variations are only moderately diverse (CLAP diversity 0.21 at identity 0.79), the paper now targets the production region rather than more diversity. Against 3 caption-based baselines, RSC keeps CLAP identity 0.78 against at most 0.24 (Tab. 1, Fig. 4).
D2) Training-free statement. Replaced by inference-time method; on Woosh, RSC also runs on the released weights (Tab. 1).
Q1) Activity-based allocation itself. Against content-aligned with random , RSC is better at 4 of 7 intervals on Woosh and 5 of 7 on SAO3, mainly at higher corruption levels (Fig. 5).
Q2) Human evaluation and more SFX types. The study is reported as a mixed result (A.3), and the FSD50K evaluation by UCS category gives an objective, though not perceptual, view across SFX types (Tables 10–11, Fig. 6).
We remain available for any further question before the deadline.
Thank you for the detailed response. The rebuttal and additional experiments have addressed my concerns, so I will keep my positive recommendation.
COMMENT 1/2: Concerns
Thank you for the supportive review and the two precise questions. You mentioned the simplicity and usefulness of the idea, while suggesting our method is not limited to a single backbone, with extended ablations and results, and that the method allows increased diversity with relatively small impact on generation quality. We answer the rest of your concerns below.
D1) Modest diversity gain and the preservation–variation trade-off. After harmonising the protocol, the WCIS gain no longer holds at U(0.7,0.85): random chunks and flow times reach 1.37 and RSC 1.33 (Tab. 2). The new Fig. 5 compares every corruption method against
RSCconsistently: against the same Woosh+DF baseline (Random Gk,τk),RSCoutperforms it at 4 of 7 intervals on Woosh and 5 of 7 on SAO3. Further, a counter-intuitive result of our calibration study is that production variations are only moderately diverse: on CLAP-LAION they reach a diversity of 0.21 against an identity of 0.79, so more diversity is not better in itself. The trade-off you point out, where more diversity comes with more identity drift, is the main limitation when generating variations of a sample: a stronger corruption regenerates more of the reference and raises diversity, but often at the cost of the elements that carry its identity, as the starting level does in SDEdit (Meng et al., 2022). The new Fig. 5 shows thatRSCimproves this balance. At matched flow-time intervals, it places more variations inside the production region than the regional and global corruption variants at four to seven of seven intervals on Woosh and SAO3, mainly at the higher-centre intervals, where the activity map keeps more of the identity; ODE inpainting on Woosh is the exception, doing better at five of seven. Against text-to-audio and audio-text-to-audio generation, the new Fig. 4 shows the gap that reference corruption fills without any text guidance (CLAP-LAION identity 0.78 against at most 0.24).Comparison to existing approach. We add 3 baselines to Tab.1 and Fig. 4, and we show a clear advantage of
RSCin the preservation-variation frontier;RSCoutperforms all three in quality (P%, R%, FAD) and identity (CLAP-LAION 0.48 vs. at most 0.24). To evaluate them on a shared protocol, we generate the same 1,500 references, 10 variations each. Qwen3-Omni-Captioner (Xu et al., 2025) describes each reference, and Qwen3-Omni-Instruct (Xu et al., 2025) condenses the description into one 35-45 word sentence. From this caption, we generate with (i) Woosh text-to-audio (Hadjeres et al., 2026), (ii) Stable Audio 3 small-sfx text-to-audio (Evans et al., 2026), and (iii) Stable Audio 3 small-sfx from the reference audio (default method init noise level of 0.9) with the prompt "create a variation of this sample that is ⟨caption⟩". While it is true that the baselines come closer to Production SFX diversity, their variations no longer match the reference.D2) Training-free statement. We agree that the training-free claim was ambiguous. RSC is an inference-time method with no per-reference training or optimization needed; it runs on a backbone adapted once to accept frame-wise flow times. On Woosh, even that adaptation is optional, since its timestep embedding can be evaluated per frame: we evaluate RSC on the released weights and show that the results remain close after adaptation; CLAP identity 0.80→0.78, P$%$ 0.93→0.90, R$%$ 0.85→0.87 and FAD 4.68→4.32 (Tab.1). For the sake of clarity we replace training-free to inference-time method. We clarify the scope in the Introduction section.