- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a unified MoE framework built on MMAudio, combining separately trained T2A and V2A expert pools through task-conditioned routing. For VT2A, a training-only intervention stochastically reserves one top-2 slot for the under-selected pool when routing is polarized. Experiments report competitive performance across the three tasks and intervention gains on polarized and off-screen VT2A cases.
Critical strengths
S1. Combining task-specific expert pools with a selective intervention is a good fit for the condition-competition problem in unified audio generation. T2A and V2A each use only their own pool, while VT2A can use both, which is a clean setup. The intervention only applies to samples flagged as polarized and always keeps the original top expert, so it gives the other pool a chance to learn without overriding per-sample preferences much. The candidate-restriction ablation in Table 2 supports this design, and I also like that the intervention is not enforced at inference.
S2. Results are strong across the three tasks and several evaluation settings. In Table 1, against MMAudio, AudioX, Omni2Sound and others, T2A is competitive and V2A and VT2A are strong. Table 3 compares the intervention on the same polarized subset, and Table 4(b) shows gains in the off-screen setting, where the text carries information the video does not. The paper reports both objective metrics and a human study, and the parameter increase is only about 7.7% (excluding the condition encoders).
Critical weaknesses
W1. The added benefit of polarization-based sample selection over generic cross-pool exploration has not been isolated. Table 3 and the polarized-subset results show that the intervention helps. But it is unclear whether this comes from targeting polarized samples or simply from making the model try the other pool more often. There is no control that applies the same amount of intervention to random samples. The threshold sensitivity study changes both which samples are targeted and how many, so it does not answer this either. Since selective, state-dependent intervention is the main distinguishing point of the method, the benefit of the polarization detection itself should be shown directly.
W2. There is no direct analysis of whether the routing-probability changes in Figure 2 translate into actual expert usage. Figure 2 looks at pre-selection routing probabilities, but the MoE output is computed with the renormalized weights of the two selected experts. The polarization measures can drop just because the scores of unselected experts change, while the actual top-2 and their weights stay the same. Also, if the expert in the reserved slot gets a small weight, its contribution to the output may be small, and the expert-to-shared lower-bound loss only looks at expert output norms before the routing weights are applied. More evidence is needed to clarify how the routing-probability changes relate to actual expert contributions and performance gains.
Questions for authors
Q1 (W1). Can the authors clarify the additional benefit of polarization-based targeting beyond increased exploration of the other pool? From the current results, I cannot tell whether the gain comes from finding polarized cases or simply from more exploration of the other pool. It would help to show, through additional experiments or analysis, which cases benefit from the intervention and which do not, and how well the proposed criterion captures that difference. For example, a comparison with random-target intervention, with the number of actual expert swaps matched as closely as possible, would be the most direct evidence.
Q2 (W2). Does the reduced polarization lead to changes in actual expert selection and output contribution? Analyses such as the fraction of tokens whose top-2 changes under the intervention, per-pool selection frequency and routing weights at inference, and weight-scaled expert output norms would show how the actual computation changes. Showing how these changes relate to the samples where performance improves would also help.
For now, I am giving a tentative score of 2, but I will consider raising the score if both are adequately addressed in the rebuttal.