- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses the problem of joint music restoration and mastering under complex, sequential degradation chains. Prior models (such as SonicMaster) were trained primarily on isolated or shallow degradations (at most three independent effects), failing to generalize to compound real-world degradations where multiple flaws co-occur and interact. The authors propose PRISM, an instruction-guided rectified flow framework trained in a frozen autoencoder latent space with FLAN-T5 text conditioning. The contributions include:
- A synthesis pipeline combining 24 degradation types (including 8 new realistic mastering and distribution flaws) into ordered chains of 1 to 8 operations across 6 realistic production scenarios, complemented by 15% pass-through pairs to teach non-intervention on clean audio. 2) Mastering Preference Optimisation (MPO), an offline alignment stage ranking perturbed latent rollouts using an equal blend of reference-free Audiobox Production Quality (PQ) and reference mel-SSIM, reinforced with a preferred-sample likelihood anchor. 3) Probing experiments demonstrating that the chain-trained model learns internal representations of acoustic damage that generalize across corpora. Validation spans synthetic chains, a collection of 574 real low-production-quality releases (WILD), and a 10-expert blind listening test. PRISM achieves substantial gains on synthetic compound chains (mel-SSIM +0.112 vs. +0.002 for SonicMaster) and preserves mastered inputs (0.978 vs. 0.821). On WILD, it improves predicted PQ by +0.509, outperforming baselines under loudness-matched conditions, though real-world perceptual superiority remains tied with SonicMaster in a small-scale listening trial.
Critical strengths
- Realistic Compound Degradation Modeling with Essential Pass-Through Preservation: By formulating degradation as deep, order-dependent chains representing real-world recording and distribution scenarios, PRISM solves a significant domain-mismatch problem overlooked by prior work. Crucially, incorporating 15% pass-through training allows the model to preserve already-mastered audio (mel-SSIM 0.978 vs 0.821 for SonicMaster), which is vital for any real-world production tool where false-positive alterations ruin professional mixes.
Critical weaknesses
- Unvalidated Perceptual Impact of MPO and Weak Instruction Disentanglement: The listening study did not include PRISM w/o MPO, making it impossible to ascertain whether the MPO alignment stage yields human-perceptible audio improvements over the base supervised model. Additionally, instruction sensitivity analysis (Table 3) reveals that natural language prompts only provide coarse on/off intervention gating rather than fine-grained control over which specific co-occurring degradation to repair.
- Inconclusive Human Perceptual Evidence on Real-World Releases: While PRISM demonstrates dramatic gains on synthetic chains (85% listener preference), its evaluation on real-world low-quality releases (WILD) in the listening test is limited to only 5 tracks and results in a tie with SonicMaster (42% vs. 42%, 95% CI [16, 68] encompassing chance). Because automated production-quality metrics (such as Audiobox PQ) are known to be vulnerable to reward hacking, the lack of statistically significant human listener preference on real commercial music weakens the claim of real-world mastery transfer.
Questions for authors
- In Table 5, on the 5 WILD items, PRISM and SonicMaster tied at 42.0%. Given that SonicMaster boosted loudness by 5.0 LU while PRISM only boosted by 1.0 LU, did listeners in the WILD trials prefer SonicMaster purely due to residual loudness bias, or were there specific artifacts introduced by PRISM? Can the authors conduct a loudness-normalized blind test on an expanded set of WILD tracks (e.g., 20+ tracks)?
- In Table 1, MPO improves WILD PQ from 5.807 to 5.873 (+0.066) while slightly degrading pass-through fidelity from 0.984 to 0.978. In informal listening, what qualitative auditory differences distinguish PRISM from PRISM w/o MPO? Did MPO improve high-frequency air, transient punch, or stereo imaging?
- Figure 3 shows that linear probing accuracy peaks around block S12-S13. What happens to the audio representations in the final layers (S14-S17) as the flow approaches the reference master? Does the network discard the degradation information to reconstruct the clean target?
3 comments
Response to Reviewer kGzi (2/2)
Q2: What changes with MPO?
We compared PRISM with PRISM without MPO on all 574 WILD tracks:
| Descriptor | PRISM minus PRISM without MPO, with 95% CI |
|---|---|
| Crest factor | +0.122 dB [0.109, 0.136] |
| Integrated loudness | -0.221 LU [-0.235, -0.207] |
| True peak | -0.050 dB [-0.067, -0.033] |
| Spectral centroid | +4 Hz [-2, +11] |
| Content ceiling | -6 Hz [-51, +35] |
MPO improves dynamics while keeping the track's tonal character intact. The crest factor increases while loudness and true peak drop slightly, so the output maintains more peak level relative to its average level and is measurably less compressed. Spectral centroid and content ceiling stay the same, which means MPO achieves this without coloring the tonal balance.
In the blind listening test, listeners chose PRISM over PRISM without MPO in 51.1% of 135 judgments (95% CI [37.0, 65.2], chance 50%), so these changes come at no audible cost.
Pass-through fidelity (how unchanged an already-mastered track is left; mel-SSIM between output and input, where 1 means untouched) stays high after MPO: 0.978, compared with 0.984 before, and well above SonicMaster's 0.821.
Q3: What happens to degradation information in the final blocks?
The network does not discard it. On PRISM's own corpus, degradation labels stay readable all the way to the last block, well above chance. What declines after S12–S13 is how well the probes transfer to a different corpus (Appendix P, "Probing analysis: details", Section P.3, Tables 16 and 17):
| Probe dataset | Best block: mean AP (cAP) | S14 | S15 | S16 | S17 | Chance mean AP |
|---|---|---|---|---|---|---|
| PRISM's own corpus | S9: 0.935 (0.90) | 0.910 (0.80) | 0.910 (0.78) | 0.930 (0.90) | 0.921 (0.89) | 0.373 |
| SonicMaster test set | S12: 0.772 (0.66) | 0.733 (0.60) | 0.682 (0.53) | 0.649 (0.50) | 0.630 (0.47) | 0.327 |
The cAP values for S14–S17 are computed from the per-group AP reported in Tables 16 and 17.
We interpret the intermediate blocks as encoding corpus-invariant degradation features, while later blocks specialize these into the output-specific correction, i.e., the predicted velocity. This is consistent with the training objective v⋆ = z⋆ − z_deg.
Depth in the network and progress along the flow are two different axes, so we also probed along the flow path, using inputs z_t = (1 − t) z_deg + t z⋆ at the best block from Table 18 (Appendix P, "Probing analysis: details", Section P.3):
| Flow time t | 0 | 0.25 | 0.5 | 0.75 | 1 (reference) |
|---|---|---|---|---|---|
| PRISM mean AP | 0.935 | 0.929 | 0.906 | 0.771 | 0.380 |
Chance mean AP is 0.373. Degradation labels remain readable through the intermediate flow states and fall to chance only at the clean reference, as expected, since no degradation is left in the input at that point. In short, the model tracks the damage for as long as there is damage to repair.
Dear Reviewer,
Thank you for your thoughtful feedback. As the discussion period draws to a close, we would appreciate hearing whether our additional experiments and responses address your concerns about MPO’s perceptual benefit, instruction control, and real-world performance, or if further clarification would be helpful.
Best regards,
Authors
Response to Reviewer kGzi (1/2)
Thank you for recognizing the realistic compound-degradation modeling and the value of pass-through training for preserving mastered audio. Below, we cover the listening evidence, whether MPO's effect is audible, instruction control, and the probing results. Intervals are paired 95% bootstrap intervals unless noted.
W2 and Q1: Listening results on WILD and the role of loudness
Thank you for the suggestion. Here are the per-track votes and loudness for the original five WILD tracks:
PRISM was preferred on the two tracks where the outputs were within 1 LU of each other (t11, t15). SonicMaster was preferred only where it was louder (1.7 and 2.5 LU), and even on t13, where it was 6.3 LU louder, PRISM matched it in votes. So loudness likely contributed to the tie, and the votes point to no particular PRISM artifact.
With loudness matched, PRISM keeps a clear lead over SonicMaster on all 574 WILD tracks: +0.345 [0.307, 0.385] PQ. We also ran a new loudness-matched listening test, reported next.
W1 and W2: Does MPO make an audible difference, and does it rely on Audiobox?
We tested this with listeners. In a blind forced-choice test on 15 items (10 from COMPOUND test, 5 from WILD), nine listeners chose between PRISM and PRISM without MPO, with all clips at -23 LUFS. PRISM was chosen in 69 of 135 judgments (51.1%, 95% CI [37.0, 65.2]) and won the majority vote on 8 of 15 items. Listeners chose the two equally often, so MPO's gains in predicted quality and fidelity come at no audible cost.
On the objective side, the WILD improvement holds up once we match each output to its input loudness. PRISM improves PQ over the input by +0.483 [0.432, 0.534], with gains on 80.7% of tracks, and it beats SonicMaster by +0.345 [0.307, 0.385].
We also checked whether MPO's gain depends on Audiobox by retraining MPO with reference mel-SSIM as the only ranking signal, so Audiobox plays no part in training. Using the 2,778 pairs where mel-SSIM picks the same two candidates as the original ranking, we keep 78% of the original MPO gain in loudness-matched WILD PQ: +0.044 [0.040, 0.049], with gains on 88% of tracks. Re-ranking all 10,000 candidate sets by mel-SSIM alone still gives +0.025 [0.021, 0.029], with gains on 71% of tracks.
So most of MPO's PQ gain survives without Audiobox in the ranking, which means the model is not simply reward hacking the metric it is evaluated on.
W1: How much control do instructions give?
Instructions change what PRISM does in two clear ways. First, on already-mastered inputs, a mismatched instruction moves the model further from the input: 1 − mel-SSIM rises from 0.022 to 0.055. The gating effect in Table 3 also grows with MPO, from +0.026 to +0.032, while SonicMaster shows no such pattern (-0.028). Second, on the SonicMaster corpus, swapping the instructions removes 39.0% of PRISM's gain, so the model uses the requested correction rather than ignoring the text.
On compound chains, PRISM repairs the named and unnamed degradations to a similar degree, with median compliance of 0.483 and 0.478 (Appendix K). So when several faults occur together, the model restores the whole chain instead of isolating the one named in the prompt.
We therefore describe the capability as instruction-dependent intervention and sensitivity to the requested correction. Selective control over individual faults within a compound chain is a natural next step, and we leave it to future work.