- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper presents V-trace PO, which is motivated by v-trace algorithm. The main idea is to use a well-designed truncation to interpolate between suffix ratio and current token ratio, thus reaching a better variance-bias tradeoff compared to the high-variance of suffix ratio and large bias of token ratio. The paper claims this method can help reuse data (if I understand correctly).
Critical strengths
The method looks reasonable and interesting.
Critical weaknesses
- The paper is basically not human readable: the structure is messy, the flow is discontinuous, the causality is weak.
- The central claims and insights are not clear.
- The experiments are limited and weak. There is only one baseline, one model and one task included. Whether the claims can generalize is unknown.
Questions for authors
- Although the full paper has 58 pages, I didn't find the proof of Proposition 2.2, which is a critical property of the proposed method.
- What's the point of Section 4 and how it connect to the proposed method?
- Can you explain what's the key points and insights of your paper?