- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduce AVRT, an audio-visual training recipe which compose of 2 training stages from SFT and RL. The framework generate independent vision and audio reasoning traces from different teacher model and then merge them with an LLM merger. The final results achieve state of the art results among comparable size models, with average 60.3 points on average across 6 audio visual benchmarks.
Critical strengths
- With only 20K SFT samples, AVRT substantially outperforms comparable-size models, which demonstrates the data efficiency of the proposed pipeline.
- The paper shows that although cross-modal reasoning data is rare, combining the knowledge of different single-modality teachers into one unified reasoning trace can still yield state-of-the-art performance compared with other methods.
Critical weaknesses
- The RL stage appears rather data-inefficient: it uses substantially more training data than the SFT stage, yet yields only a marginal improvement.
- An ablation for the SFT-only setting is missing, which is essential for isolating the actual contribution of the RL stage.
Questions for authors
The effectiveness of RL seems limited in this paper. What do the authors attribute this to?