- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper compares SimCSE against a negative-free SIGReg objective in a shared pipeline. Within InfoNCE, it varies how many negatives are kept and whether negatives in same topics are removed. On RoBERTa-base, it finds that negatives raise STS but hurt clustering at development-selected checkpoints, and keeping more negatives reproduces this trade. Dropping same topic rather than random negatives improves clustering. Uniformity and a distributional shape statistic forecast the two sides within a backbone.
Critical strengths
None.
Critical weaknesses
- The paper is extremely hard to read, and the main argument depends on material outside the submission. The main text reads as a summary of a lab notebook. Nearly every sentence carries a status mark (⋆, *, ○, †, ↓, “desc.”), or a cross-reference.
- The package comparison is confounded by tuning and checkpoint selection. The two objectives received different tuning budgets: SimCSE got a 6-trial lr × τ grid at 1M, while SIGReg got 8 λ values at 250k, and SIGReg’s learning rate was never swept.
Questions for authors
Could the essential evidence be moved into the paper’s own appendix instead of rest only on the Extended Materials?