- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how base-model optimizers affect SAE reconstruction quality. Controlled experiments show a consistent reconstruction deficit for spectral updates at the final residual stream, while comparisons at intermediate layers can reverse the ordering.
Critical strengths
- Extensive controls make the final-layer finding convincing. Learning-rate sweeps, isolated update rules, exact-SVD updates, and alternative SAE architectures address several plausible explanations.
- Depth-dependent reconstruction and the JumpReLU sparsity mismatch offer useful lessons for cross-model SAE evaluation. Reporting unsuccessful hypotheses also helps delimit the conclusions.
Critical weaknesses
-
Attribution of the depth reversal remains incomplete. The isolated update family reproduces the final-layer deficit but fails to establish a reversal above the paper’s effect-size threshold at usable sites (Appendix J). Thus, the reversal observed with the named optimizers cannot yet be attributed specifically to update geometry.
-
SAE fitting failures leave important comparisons unresolved. Most intermediate sites become inadmissible at larger scales under the matched-compute protocol, and longer training removes the usable intermediate sites at 60.5M. These failures limit the depth-dependent conclusion. Testing whether centering or separately tuning the SAE restores reliable comparisons would strengthen the evidence.
-
Relevance to standard pretrained models remains uncertain. Most scale runs use only 1–5 tokens per parameter, and Appendix A shows substantial differences between their activation statistics and those of GPT-2 and Pythia. Longer training changes the gap substantially at 60.5M, leaving its behavior in mature representations unresolved.
-
Readability needs substantial improvement. Dense numerical passages, repeated accounts of superseded analyses, and frequent appendix references obscure the central argument. Separating the robust final-layer result from the more conditional depth and mechanism findings would make the contribution easier to assess.
Questions for authors
Typos
- Section 5.2: “too. the number to report” → “too. The number to report”.
- Appendix E states that all three runs miss the 1.5% loss-parity threshold, although Table 7 reports 1.0145 for 60.5M, which falls within it. The corresponding statement in Section 3 also needs correction.
Thank you for the constructive review, and for engaging so closely with the controls. We accept your assessment.
Both corrections are right. At matched loss, 60.5M does meet the 1.5% parity threshold, and the text in Section 3 and Appendix E was wrong to say otherwise.
You're also right that the depth reversal can't yet be put down to update geometry. When we looked again, it turned out to be mostly a difference from the SGD arm. Against Adam, the spectral arm only does better at one site in three of the four runs, by at most 0.019, and not at all at 60.5M. So your caution was, if anything, too mild. The SAE fitting failures and the open question about mature models are real limits as well.
Your suggestion to lead with the final-layer result and treat the depth and mechanism findings as conditional is the right way to read this work. Thank you.