- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper propose a problem: Using a long caption to controllable song generation. Current method doesn't follow the tempora; control. They proposed MusicSTAR, using attention routing and ocal-to-global preference optimization to ensure section-level controllability and whole-song musicality.
Critical strengths
- The framing is clean, and the solution is convincing.
- The demo results sound good.
- The paper provides ablation studies for the proposed method in Tables 4 and 5.
Critical weaknesses
1. Many symbols in the method section are undefined or underspecified, which makes the section hard to follow. For example:
- Undefined symbols. and in Eq. 1 are never defined, and neither is in Eq. 6.
- Unclear indexing and notation. is called a "step," a "frame," and an "audio query position" at different points, and the paper never says whether these refer to the same index. The relation between and $ l_i $ is not stated. The ordering and positional encoding used by in Eq. 5 are also unspecified, as is where is applied.
- Training details. The boundary label, the boundary loss, and the full training objective are never written out. The paper also does not explain how is set during training.
- Hyperparameters and settings. The values of , , , , and are not reported, and it is unclear how changes with . The reference model in Eq. 14 is not specified, nor are the layers and heads modified by Eqs. 9-10.
A notation table and a hyperparameter table would make the paper much easier to read and reproduce.
2. The related work is thin (about 20 references) and omits several closely related lines of work. In particular:
- Attention steering (closest to Temporal Attention Redistribution, §3.3.2): PASTA (Zhang et al., ICLR 2024) re-weights attention toward user-specified spans after the fact and then renormalizes, which is very close to Eqs. 9-10. Prompt-to-Prompt (Hertz et al., ICLR 2023) controls generation by editing cross-attention maps.
- Sequential or time-varying prompts in video generation (the same problem of routing ordered text conditions over time): Phenaki (Villegas et al., ICLR 2023), DiTCtrl (Cai et al., CVPR 2025), and Mind the Time (Wu et al., CVPR 2025).
- Monotonic alignment (closest to the section pointer, §3.3.1): monotonic attention (Raffel et al., ICML 2017) and MoChA (Chiu & Raffel, ICLR 2018).
- Fine-grained preference optimization (closest to Section-DPO, §3.5): Fine-Grained RLHF (Wu et al., NeurIPS 2023), Token-level DPO (Zeng et al., ICML 2024), and Step-DPO (Lai et al., 2024). The length-normalized objective in Eq. 13 also resembles SimPO (Meng et al., NeurIPS 2024).
- Temporally controlled music generation beyond Music ControlNet and Mustango: MuseControlLite (Tsai et al., ICML 2025) and long-form structured generation with Stable Audio (Evans et al., ISMIR 2024).
- Foundational music and song generation: Jukebox (Dhariwal et al., 2020), MusicLM (Agostinelli et al., 2023), MusicGen (Copet et al., NeurIPS 2023), and SongGen (Liu et al., ICML 2025).
- Evaluation resources: MuLan (Huang et al., ISMIR 2022) is used both as a reward and as an evaluation metric but is never cited. SongEval (Yao et al., 2025), a benchmark for song aesthetics, would provide a useful independent check, since SongBench is also used as the Song-DPO reward.
3. The evaluation is incomplete. Nothing in the paper measures boundary accuracy or whether the generated sections match the requested ones in number, order, and duration. For example, the authors should report whether the pointer reaches the final section before the end of the sequence. In addition, users cannot specify section durations, so "temporal control" here covers ordering only. The paper should state this clearly as a limitation.
Questions for authors
-
Test set and baselines.
- How large is the test set, and where does it come from?
- How were the section captions converted into the input format each baseline expects?
- Does every baseline receive the same information?
-
Structural metrics. Could you report the following?
- Boundary F-measure (e.g., at ±0.5 s and ±3 s tolerances), along with how the generated boundaries are obtained (from the pointer or from an external structure analyzer).
- Section count accuracy and order fidelity, e.g., the edit distance between the requested and generated section sequences.
- Section completion rate, i.e., the fraction of samples in which every requested section appears before the end of the sequence.
Also, how are failure cases, such as a missing section or a pointer that stops early, counted in these metrics?
Dear reviewers,
The authors have submitted their rebuttals. Please take a look and interact with the authors if necessary.
Thanks a lot.
AC