- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Pion, a spectral high-pass optimizer designed to address Muon’s limitations in VLA and RLVR post-training. It replaces uniform spectral whitening with two-stage promotion–suppression iterations that preserve dominant singular directions while attenuating noisy tails, and adds per-head processing for RLVR. Experiments show improved VLA performance with a module-specific hybrid optimizer configuration and stable RLVR training in settings where Muon collapses.
Critical strengths
- Useful ablations. Module-wise optimizer comparisons, per-head experiments, learning-rate sweeps, and reverse-filtering ablations provide evidence supporting the proposed design.
- Physical validation. The VLA experiments cover regression and flow-matching action models, along with a real-robot evaluation.
Critical weaknesses
-
No clear criterion for choosing Pion. The paper identifies low effective rank and low SNR as relevant characteristics, but does not establish a validated rule for selecting Pion over Muon or AdamW. Neither condition alone guarantees that small singular directions contain noise rather than useful information. The directional-SNR analysis supports this assumption in one RLVR setting, but its generality remains unclear.
-
RLVR validation is limited. Experiments use only Qwen3-1.7B and Qwen3-4B,and two mathematical reasoning datasets. The author should provide more results on other benchmark and model familes.
-
The method’s scope is insufficiently characterized. VLA imitation learning and language-model RLVR differ substantially in objectives, supervision, architectures, and optimization dynamics. A shared spectral explanation is plausible, but success in these two settings does not yet establish a predictive characterization of where Pion should work. The paper needs stronger evidence that the proposed spectral conditions predict gains across tasks and models.
Questions for authors
See weakness above.
Thank you for addressing my questions. I will keep my positive score.