- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes UniAdapt, a content-adaptive token allocation framework for frozen RVQ-based audio codecs. Instead of assigning a fixed RVQ depth to each frame, UniAdapt predicts the marginal utility of individual RVQ refinements and dynamically allocates tokens under serialized-bit budget constraints. The framework combines a rate-independent causal utility predictor, a primal–dual allocator, and an exact prefix-feasibility guard. An optional semantic utility head is also introduced for offline speech allocation. The proposed approach is evaluated across multiple audio domains and bitrates, including both offline and causal streaming settings.
Critical strengths
- The paper provides comprehensive evaluations across different audio domains, bitrates, downstream tasks, and streaming settings, demonstrating consistent reconstruction improvements in the offline setting.
- The proposed exact prefix-budget enforcement is practically meaningful, as it accounts for actual serialization overhead and ensures that causal allocation remains within the matched fixed-depth budget.
Critical weaknesses
- The large performance gap between online and offline oracle allocation raises questions about the effectiveness of the proposed causal allocation strategy.
- The lack of comparisons with simpler causal allocation baselines makes it difficult to assess the advantages of the proposed method over less complex alternatives.
Questions for authors
-
How does UniAdapt compare with simpler causal allocation strategies, such as greedy allocation or residual-based heuristics, under the same exact budget constraints?
-
The performance gap between online and offline oracle allocation is substantial. Could the authors further analyze whether this gap mainly arises from causal information constraints, prefix-budget enforcement, or limitations of the proposed allocation strategy?
I appreciate the authors for their extra experiments (point 2 and 4) and detailed responses. Nevertheless, the main concern on the significance of improvements still remains. Also, although I do appreciate authors' promise regarding the future refinement on the manuscript, the current state of the manuscript is not updated yet nor sufficiently clear in the standard of scientific writing. Therefore, I am inclined toward keeping my original score.