- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper defines tailness as the product of class rarity and the per-class error rate of the SFT model. And the proposed TARS designs a weighted GRPO objective based on class tailness.
Critical strengths
- The paper is well-written and easy to follow.
- The proposed tailness and TARS are simple yet effective. Across different benchmarks and tasks, TARS outperforms other RL based variants.
Critical weaknesses
1.Class-difficulty based reweighting is not fundamentally new, [1] and Difficulty-net also uses reweighting technology based on class-level difficulty. Difficulty-net is cited in this paper, however the discussion does not fully explain how its class-difficulty reweighting differs conceptually.
[1]Sinha, Saptarshi, Hiroki Ohashi, and Katsuyuki Nakamura. "Class-difficulty based methods for long-tailed visual recognition." International Journal of Computer Vision 130.10 (2022): 2517-2531.
2.The paper evaluates per-class error rate using training set performance using initial SFT model, which might be noisy for tail classes. A class with only a handful of examples could receive a very different tailness weight depending on one or two predictions.
Questions for authors
Please address the critical weaknesses.