- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Music World Model, a hierarchical framework for controllable long-form symbolic music generation. MWM combines a phrase-level planner with a segment-level executor to model musical evolution under structural actions, allowing the model to replan based on generated history. To mitigate structural drift during recursive generation, the authors introduce Boundary-Aware History Correction (BHC), an inference-time mechanism that combines context anchoring with persistent correction memory. The authors also construct Slakh-Action to support action-conditioned training and evaluation, and conduct experiments to demonstrate the effectiveness of the proposed framework.
Critical strengths
- The paper addresses the important challenge of maintaining structural consistency and controllability in long-form symbolic music generation. The proposed plan–generate–replan framework provides an interesting perspective on interactive music generation. -The paper presents a relatively complete technical framework, integrating hierarchical planning, action-conditioned generation, and inference-time history correction. The overall design is coherent, and the individual components are motivated by specific challenges in long-horizon generation.
- The authors conduct a broad range of experiments, including comparisons with existing methods, subjective evaluations, counterfactual action tests, long-horizon generation, and ablation studies. These experiments provide useful insights into the behavior of the proposed framework.
Critical weaknesses
-
While the paper presents the proposed approach as a Music World Model, it is not entirely clear how the underlying task differs from conventional conditional symbolic music generation. The framework predicts future musical content based on historical states and structural controls, which seems closely related to existing conditional generation approaches. Furthermore, the training actions are derived from structural differences between consecutive phrases in existing music, rather than from actual user interventions. This raises questions about whether these inferred actions accurately reflect real user intentions and whether the learned dynamics can effectively respond to user-specified interventions in practical scenarios. how the proposed framework demonstrates the predictive and generalization capabilities expected of world models, beyond conditional continuation with predefined structural attributes.
-
In Table 9, the full MWM model performs worse than several simplified variants, including the No-plan and Executor-only configurations, across multiple evaluation metrics. But the authors didnt discuss these results.
-
The relationship between the action and the control descriptors could be explained more clearly. In particular, how would the model handle situations where the action and control descriptors specify conflicting changes?
-
how the proposed method differs from existing approaches to long-form symbolic music generation, particularly Anchored Cyclic Generation (ACG) and its hierarchical extension.
-
While the paper presents a relatively comprehensive technical framework, some parts of the presentation could be simplified to improve readability. The large number of concepts, representations, symbols, and technical terms makes it challenging to follow the relationships between different components and grasp the main methodological ideas. Additionally, some terminology and notation appear inconsistent between the main text and the appendices.
Questions for authors
refer to the weakness
3 comments
thanks for your response. i will keep my score
Thank you for your response. We respect your decision to maintain your original score. However, we would sincerely appreciate it if you could provide more specific reasons or further justification for your assessment, particularly regarding which concerns remain unresolved despite our detailed responses. Without concrete feedback, it is difficult for us to understand why our manuscript does not meet your expectations or how we can meaningfully improve our work. We believe that constructive and specific feedback is essential to the peer-review process, and we would be grateful if you could elaborate on the key issues underlying your decision.
1. World-model distinction.
MWM explicitly models musical state–action transitions and replans from generated results, examining how the same starting point develops under different interventions. Phrase differences supervise musical changes during training as proxies for interventions, not direct observations of user intent, while our agent translates user intentions into tempo, density, and role-activity controls through the same action interface. Instruction comparisons and multi-step prediction experiments on held-out songs evaluate intervention responses and predictive ability. Generalization here means applying learned controls to unseen musical contexts. The anonymous link provides complete code and configurations for inspecting intent interpretation and generation.
2. Planner (Table 9).
We acknowledge that Executor-only and No-plan achieve better results on several metrics. This is mainly because the planner introduces additional constraints on how the music develops, while removing it gives the executor more freedom to generate music that matches local statistical patterns, leading to better scores on some metrics. However, our goal in introducing the planner is not simply to improve these scores, but to organize how music develops across multiple phrases. Without a planner, the model can maintain good scores by repeating similar chords or rhythmic patterns, but this can also make longer pieces sound repetitive. In contrast, the planner helps organize changes across phrases and gives the music a clearer overall structure. Therefore, its main benefit lies in long-term musical development rather than local metrics alone. We provide audio demos to illustrate these differences, while acknowledging that current objective metrics do not directly establish this advantage. BHC is disabled in Table 9; Full(BHC) results are shown below, and we will compare the other variants with BHC enabled. We will add cross-phrase structural analyses and listening evaluations to better demonstrate the planner's value.
3. Actions and descriptors.
The user expresses an intention, which the agent translates into a structured action. The system then combines this action with the current musical state to form control descriptors for generation. For example, “make the next phrase denser” becomes a density-increase action, which is interpreted relative to the current density to establish the corresponding target. The action expresses how to change, while the descriptors express the desired state. They belong to the same control pipeline rather than two independently supplied user instructions, so conflicting action–descriptor specifications do not arise in the intended workflow.
4. ACG and Hi-ACG.
ACG supports long-sequence generation through anchor feedback, while Hi-ACG adds whole-piece sketches and local refinement. MWM centers on interaction and explicit actions: users can adjust density, tempo, or role activity at phrase boundaries, and the model predicts subsequent music from the current state and action, then replans from generated results. Users can therefore listen and revise instructions as generation unfolds, reflecting the action-conditioned prediction and feedback capabilities of a world model.
5. Presentation.
We will further simplify the technical descriptions, reduce unnecessary terminology and notation, and ensure consistency between the main text and appendices while correcting related errors. We will also add a clear and concise overview diagram to show the role of each component and how they connect, making it easier for readers to understand the main idea and overall workflow of our method. The overall framework diagram is provided in the first section of the supplementary material.