- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces editing by demonstration for music: instead of a text instruction, a before–after audio pair specifies an edit, and the goal is to transfer that edit to unseen music. The proposed method, Edit Condition Synthesis, works with a frozen flow-matching music editor (MelodyFlow). Given a demonstration pair, the authors encode source and target, build two flow states sharing the same noise draw, and use their relative target velocity as the transition signal — the noise term cancels exactly, leaving a deterministic source-to-target direction (Eq. 11). A continuous condition is then optimized in the editor's native conditioning space so that the condition-induced relative dynamics match this demonstrated transition (Eq. 13), which makes the condition executable without retraining the generator. To keep the condition transferable rather than tied to the reference track, they adapt MuQ into a transition encoder with a contrastive objective over edit types and add a transition-consistency term 1 − cos between the demonstrated transition and the transition induced by the synthesized edit (Eqs. 16–18). Two paired benchmarks are constructed: instrument editing from Slakh2100-redux (7,500 pairs) and style editing from MusicCaps/MeLBench (8,400 pairs), each with ~10% no-op samples and piece-level splits. The method outperforms eight baselines (text-guided flow editors, adapted demonstration-based methods VISII/EditCLIP, and audio analogy) on automatic metrics, with ablations for each component and a 16-person user study.
Critical strengths
For a new task, the experimental protocol is careful and honest: two paired benchmarks with no-op controls and splits by musical piece, demonstration-based baselines (VISII, EditCLIP) re-implemented on the same editor rather than quoted from other domains, per-component ablations including the depth of MuQ adaptation, a λ sensitivity sweep, and a small subjective study. The AI-use statement is appreciated.
Critical weaknesses
-
Transfer is demonstrated only among edit types the transition encoder was trained on (instrument add/remove/replace and seven styles). Since the contrastive objective defines the edit space, generalization to a genuinely novel transformation — arguably the main selling point of demonstration-based editing — is untested, and the paper offers no mechanism to detect when a demonstration falls outside the trained edit space.
-
After listening to the audio examples on the authors' demo page, I am less convinced that the synthesized condition reliably captures the demonstrated edit. In several of the examples the edited output does not audibly reflect the transformation shown in the before–after pair: the change in the demonstrated direction is weak or hard to notice. I know qualitative listening is not a substitute for metrics, and the demo examples may not be representative, but for a paper whose central claim is that the recovered condition encodes the transferable transformation, what I heard on the demo page suggests a gap between the automatic numbers and perceived edit strength. The paper contains no failure analysis of partial transfers, and none of the reported metrics (FAD, CLAP, EIA) directly measures whether the demonstrated change is audible to a listener.
Questions for authors
-
How long does condition synthesis take per demonstration (optimization steps, wall-clock time, memory), and how does output quality vary with the optimization budget? A convergence curve would substantially strengthen the practical case.
-
Are the examples on the demo page representative of typical behavior? In several of them the edit is barely audible relative to the demonstrated pair. Could you report a failure analysis over the test set quantifying how often the transferred edit is only partial or effectively a no-op, and how often listeners can identify the demonstrated transformation in a blind A/B setting?
Summary of Rebuttal Updates and Discussion
Dear Program Chairs, Senior Area Chairs, Area Chair, and Reviewers,
Thank you for the thoughtful reviews and for taking the time to consider our responses and listen to the updated demos. As the discussion period draws to a close, we would like to summarize the main updates and outcomes.
Method clarification and demo correction (Reviewer 2Yry). We revised Figure 2 to clarify how the editing condition is learned and reused, and explained how transfer depends on the frozen editor. We also corrected Example 09 to show the demonstration-guided and text-conditioned outputs side by side. The reviewer appreciated the revisions, acknowledged the gains over the baselines, and maintained their positive rating.
Demonstration-based control and evaluation (Reviewer Pp4k). We clarified how audio demonstrations refine the text-initialized condition and guide instrument removal while preserving unrelated content in the query. We cited the comparison with text prompts (main paper Table 4) and our higher edit audibility ratings (rebuttal Table 14). Source preservation varies across examples, and New 3’s listener ratings reflect the same loss of content the reviewer heard. For New 6, we clarified that the two demonstration clips need not have similar musical content and added Example A to illustrate a more focused style edit.
Additional evidence and remaining limitations (Reviewer D6vi). The reviewer found that the additional experiments addressed their main concerns and raised their rating from 2 to 3. We clarified that generalization to genuinely new edit operations remains unverified and that the current method cannot detect demonstrations outside its supported edit space.
We appreciate the constructive discussion and your consideration of the revised manuscript.
Best regards,
The Authors