- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors focused on attention decrease of the input aduio in long-term aduio reaonsing. Specifically, they proposed MAPO, which assigns weights to different tokens in GRPO. Also, an additional loss was proposed to encourage models to focus on the input audio itself. I think the problem is practical, the method is reasonable, and the authors have provided more evaluations apart from accuracy performance.
Critical strengths
-
First of all, I think the problem is practical, and the proposed technique is reaonable. These strengths highlight the authors indeed have a deep understanding of this direction.
-
Second, the tehnique part is clear and easy-to-understand. The relationships between MAPO and GRPO is clear, and the authors also provide the experimental comparisons between MAPO and GRPO under similar settings.
-
Third, the evaluation part is sound as the authors provide an experiment about no/mask/wrong audios apart from accuracy performance. A bad case is also provided in the appendix, which help readers know the shortcomings of their proposed method.
Critical weaknesses
I am not an expert about audio, I mainly focus on textual language models. I raise some concerns from my own perspective, and I hope it will be benifical for the authors to improve the manuscript.
-
I am not fully sure whether the entropy difference during training only reflects the effect of audio. The text-only reference model is frozen, while the policy model keeps changing.
-
Tokens in the same response still share the same sequence-level advantage. For example, an audio-related token could be correct, but receive a negative update because the final answer is wrong.
-
There are quite a few missing results in the appendix. It would be better if the authors could explain these missing results, or fill in as many as possible.
-
Minor issues: some figures are difficult to read. For example, the labels and legends in Figures 2 and 8 are quite small, and the text above the plots in Figure 8 is shortened. Also, the authors have provided rich information in the appendix, but the main text still has some blank space, so I think maybe they can organize the manuscript better.
Questions for authors
Please refer to the Critical Weaknesses part.
5 comments
2. Audio-critical tokens and correctness of reasoning steps
Tokens in the same response still share the same sequence-level advantage. For example, an audio-related token could be correct, but receive a negative update because the final answer is wrong.
The example is helpful because it distinguishes audio relevance from semantic correctness. A correct audio-related token is updated according to all the sampled completions in which it appears, not only the one with the wrong answer, because the advantage is computed relative to the eight completions sampled for the same question (Section 2). Within a completion that scores below the group average, the shared advantage does give every token a negative term, yet the same token receives a positive term wherever it appears in a completion that scores above the average, and when all eight completions receive the same reward the advantage is zero for each of them. The net effect therefore depends on whether the token appears more often in the higher-scoring or the lower-scoring completions, which over training favors tokens that contribute to higher rewards. Audio relevance enters through MAPO's weights, which are positive and change only the magnitude of each token's term, not its direction, so a larger weight on an audio-critical token does not by itself lower its probability, and it strengthens the reinforcement of a token that appears mostly in the higher-scoring completions.
Feedback on an individual token within a single response, as opposed to across the group, would require a finer-grained semantic assessment of the generated CoT, such as step-wise process rewards that evaluate individual reasoning steps. This form of supervision is complementary to MAPO's focus on acoustic grounding. Section 2 discusses MAPO's compatibility with sequence-level reward strategies, and in the same way step-wise CoT rewards could further refine which intermediate steps should be reinforced, while MAPO's weights determine their relative emphasis according to audio relevance. The two approaches can therefore guide the same policy optimization through complementary roles: reasoning supervision supplies finer-grained feedback on correctness, and MAPO directs learning toward audio-critical positions. We will add this discussion to the revision.
3. Completing the appendix baseline comparisons
There are quite a few missing results in the appendix. It would be better if the authors could explain these missing results, or fill in as many as possible.
To fill in as many of the missing results as possible at this stage, we evaluated the public Covo-Audio-Chat and Step-Audio-R1 checkpoints on MMAR and MMAU-Pro, using their released model weights and audio encoders. The additional results are:
| Model | MMAR accuracy (%) | MMAU-Pro score (%) |
|---|---|---|
| Covo-Audio-Chat | 50.80 | 47.40 |
| Step-Audio-R1 | 70.20 | 57.27 |
We also located additional published results in the MiMo-Audio paper (Table 8). These will be included as cited scores from that evaluation:
| Model | Published MMAR accuracy (%) | Published MMAU-Pro score (%) |
|---|---|---|
| Audio Flamingo 3 | 58.50 | 51.70 |
| MiMo-Audio-7B-Instruct | 63.60 | 53.35 |
We will also incorporate our new evaluations and their category breakdowns, together with these additional cited scores, into the appendix, with clear attribution of each source. These additions broaden the coverage of public audio models and make the comparison easier to assess, and the dashes that remain are mostly for human baselines and proprietary systems.
4. Figure readability and manuscript organization
Minor issues: some figures are difficult to read. For example, the labels and legends in Figures 2 and 8 are quite small, and the text above the plots in Figure 8 is shortened. Also, the authors have provided rich information in the appendix, but the main text still has some blank space, so I think maybe they can organize the manuscript better.
Thank you for the helpful suggestions on presentation. We will do our best to incorporate them in the revision by improving the readability of the labels and legends in Figures 2 and 8, restoring the full text above the plots in Figure 8, and using the available main-text space to present key appendix findings more prominently.
Thank you for the thoughtful review and for recognizing the importance of evaluating audio use alongside answer accuracy.
1. Effect of the frozen reference on the entropy signal and token weights
The entropy difference in training combines the effect of audio with a smaller shift introduced by training, and the token weights it produces stay close to those from a same-checkpoint reference. To separate the effect of audio from changes introduced by training, we measured next-token predictive entropy in three conditions: trained MAPO with audio, the same checkpoint without acoustic features, and the base model without acoustic features. The question, saved response prefix, and token positions were held fixed. Comparing MAPO with and without audio measures how audio changes the trained model's uncertainty. Comparing the two text-only predictions measures the entropy shift associated with training. An additional experiment gave the following mean absolute entropy differences:
The text-only shift is therefore smaller than the within-MAPO audio/text effect, at about 55% of its magnitude. Because the reference entropy enters training only through the token weights of the two branches, we also examined how reference choice affects the resulting token weights in a separate replay of 100 MMAU questions and 44,269 saved response tokens, using the released MAPO weighting rule. At the final checkpoint, which is the furthest in training from the frozen reference, frozen-reference and same-checkpoint weights have Spearman rank correlations of 0.860 for the policy branch and 0.866 for the inverse-attention branch. Changing the reference redistributes 2.8% and 2.5% of normalized weight mass, respectively. This close agreement at the end of training indicates that the two choices of reference give similar training signals.
We use the frozen reference to reduce GPU memory overhead by reusing the model already maintained for GRPO's KL penalty, avoiding a separate entropy-reference model. A fixed reference also allows the text-only pass to be computed once per rollout batch and reused across the four optimizer updates (Appendix H.2), whereas a reference that follows the policy would need to be recomputed after every update. Given the smaller text-only shift and the strong agreement in normalized token weights, we regard this as a reasonable balance between preserving the weighting signal and limiting memory use and training time in our training setup.