- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper targets a key limitation in audio QA: standard RL rewards only check final answers and formats, rewarding lucky guesses equally without distinguishing genuine reasoning. To avoid training an external reward model, the authors propose AudioRSI, where the model generates multiple reasoning trajectories as an Actor and evaluates them pairwise using a frozen copy of itself as a Critic.
Critical strengths
- Audio-conditioned self-critique requires neither a separately trained reward model nor human step-level labels.
Critical weaknesses
-
Self-critique reliability is inadequately validated. The human audit covers only four cases. Critic quality is not tracked across checkpoints. Better answering has not been shown to yield better CoT supervision.
-
The added benefit and cost are unclear. MMAU exceeds the quoted Omni-R1 (AVQA) score by only 0.3 points; MMSU omits that baseline.
Questions for authors
-
A key premise of this work seems to be that a multimodal model’s ability to verify/supervise its own chain of thought (CoT) is more accurate than its ability to generate it. Did the authors empirically validate this assumption, or provide a detailed justification for why it holds?
-
Please report Omni-R1's MMSU Perception and Reasoning scores under the same protocol. Does additional CoT supervision yield reliable speech-understanding gains?
-
Please give more figures about the training of AudioRSI(reward and others) to help me better understand how RSI works.