- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper proposed SAuBER, an audio coding method from learnable MDCT tokenizer and energy-based refinement. The idea is a good one. The experiments are carried on the MUSDB18 dataset to show the effectiveness of the method. I like this paper. But the writing, figures, equations are very rough for a formal publication. I lean to accept this paper, on the condition that the authors must completely rewrite this paper.
Critical strengths
-
The idea of using MDCT for building codec is a nice one.
-
The idea of using energy-based method is also a good one.
Critical weaknesses
-
The writing is very rough. The figures are not well formatted and do not look professional.
-
Many equations are rough. The equations are also not formmated and the readability is low. I can hardly understand many equations.
-
Many important model architectures and contents are in the appendix and should be moved to the main text. Many content in the main text should be removed or compressed.
-
There is a lack of total pipeline figure of the system.
-
Details of how MDCT convert audio into coefficients are lacked.
-
Equations (3) and (4) are hard to understand.
-
For robustness, what are the ablation result for with an without injecting Gaussian noise?
-
Many important contents, such as Appendix A.1, A.2 should be moved to the main texts. A reader may skip reading the appendix but only read the main text.
-
The authors mentioned energy-based model. What is the advantage of use energy-based model? How it is improved over other non energy-based models?
Questions for authors
- See critical weaknesses.
2 comments
I have read through the comments from the authors. I would keep the score unchanged.
We thank the reviewer for the positive assessment and the clear, actionable list of suggestions. We have taken the request for a thorough restructuring and rewrite seriously, carefully revising the manuscript to address every point raised.
Writing, figures, and equations (W1, W2). All diagrams have been newly redrawn, and all plots now share a unified visual style. To improve clarity and readability, we have reformulated the equations for the tokenizer (formerly Eqs. 3 and 4), the time-frequency loss, the quantizer, the rate losses, and the refinement objectives (along with Algorithm 1). Additionally, secondary analyses have been relocated to the appendix with dedicated, self-contained explanations.
Pipeline figure (W4). Several figures have been added or revised to clearly illustrate the overall coding pipeline, training procedure, and module architecture. Specifically, Fig. 1(a) depicts the end-to-end inference pipeline, while Fig. 1(b) illustrates the frame-wise refinement process. Fig. 2 outlines the three training stages, explicitly indicating which modules are trained and frozen, all associated loss terms, and the stop-gradient operations. Finally, Fig. 3 details the underlying model architectures.
Architecture in the main text (W3, W8). The encoder, decoder, quantizer, density model, and refinement head are now described directly in the main text (§3.2–3.3), replacing the architectural details previously placed in the appendix.
MDCT details (W5). Section 3.1 now explicitly specifies the MDCT configuration and patchification process. Specifically, the MDCT employs a 512-sample sine window with a hop size of 256 (Nbins=256), and each patch spans 8 frequency bins × 4 frames per subband (D=32, corresponding to 32 tokens per 1024 samples).
Ablation without noise injection (W7). To isolate the effect of the noise injection, we trained a variant of the subband tokenizer without the noisy channel (pnc=0), while keeping all other hyperparameters identical, and subsequently trained the 24 kbps autoencoder and refinement head following the exact same recipe (§4.4, Fig. A.11).
While both tokenizers remain near-transparent on clean input, omitting the noisy channel causes the learned layers to amplify perturbations in the token space. Because the autoencoder's reconstruction error acts precisely as such a perturbation, the BAE degrades substantially, and the refinement head compounds this degradation even further. Noise injection is therefore essential for regularizing the token-space and enabling stable iterative refinement.
What the energy-based formulation brings (W9). Please refer to our response to Reviewer 875q (§4.3, Figs. 6–7). Under identical architectures, inputs, and training conditions, the energy-gradient target consistently outperforms standard flow matching across all step counts (Nstep) on the uniform grid, whereas a one-step regression head yields negligible improvement over the decoder output. Furthermore, unlike the flow matching objective, our energy-based formulation provides a tunable step size η to control the quality trade-off across different metrics and allows explicit differentiable quality metrics, such as the proposed time-frequency loss, to be directly incorporated into the generative refinement process.
Clarification. Only the training split of MUSDB18-HQ is included in our training data, ensuring strict separation from evaluation. Our evaluation comprises the 43 USAC test items along with three newly added test sets, including the held-out MUSDB18-HQ test split (App. A.6.1).
We hope the revised manuscript satisfies the reviewer's concerns, and we would be glad to refine any remaining passages that could be further improved.