- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper combines majority-vote test-time RL with per-layer additive bias adaptation, training roughly 100K parameters while freezing the pretrained model. It evaluates text, visual and audio tasks, compares with voting, LoRA and full fine-tuning, and reports transfer from MATH-500 to 4,500 disjoint MATH problems. Conditional pseudo-label and projected-gradient analyses motivate the approach, with empirical studies of consensus and layer-wise gradient energy. The submission also audits task-specific sources of multimodal improvement.
Critical strengths
Practical evidence for extremely small label-free adaptation. Three-seed results and a label-source by parameterization comparison show gains with about 100K parameters. The frozen transfer experiment demonstrates that the result extends beyond the exact adaptation questions
Critical weaknesses
The conceptual novelty and breadth are limited. The method directly combines existing TTRL and bias-only RL. The main scientific contribution is therefore a useful empirical combination, with a narrower demonstrated scope.
Questions for authors
Were LoRA and ReFT allowed comparable configuration search budgets and suitable learning rates?