- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how scaling introduced by a model's linear readout affects sparse autoencoder feature learning. The authors introduce readout-canonicalized decision-space coordinates, which remove readout singular-value gains while preserving the retained decision information. The paper provides a mathematical analysis of the equivalence between scaled and gain-free representations, together with an exact training wrapper. Synthetic experiments demonstrate substantial improvements in sparse factor recovery when scaling is removed, while also showing that the benefit can reverse depending on the generating distribution.
Critical strengths
-
The paper investigates an important aspect of SAE training that is often overlooked: how coordinate scaling affects learned features despite preserving the underlying information. The mathematical formulation and controlled synthetic experiments provide useful insights, particularly the observation that the preferred coordinate system depends on the generating geometry rather than the readout condition number alone.
-
The authors evaluate multiple coordinate choices, reconstruction metrics, training budgets, and downstream applications. The exact-wrapper experiment helps distinguish information preservation from optimization effects, while the hidden-state, whitening, and raw-coordinate controls strengthen the analysis. I also appreciate the transparent reporting of negative results and limitations.
Critical weaknesses
-
Although RC-DS improves synthetic factor recovery and gain-free reconstruction in several settings, its advantages do not consistently extend to semantic label detection or steering. In the full-vocabulary experiments, logit-trained SAEs generally provide better logit reconstruction, while raw singular-coordinate probes outperform the mean trained RC-DS detectors across the evaluated settings. These findings limit the demonstrated practical benefits of the proposed coordinate transformation.
-
The empirical advantages depend on training budgets, coordinate choices, and evaluation metrics. Longer training and separate hyperparameter tuning substantially reduce some reconstruction gaps, and several fits do not satisfy the reported stability criteria. Moreover, the real-model evaluations cover a relatively small set of frozen language models and policies. These limitations make it difficult to determine how broadly the observed advantages generalize.
Questions for authors
- To what extent do the observed RC-DS advantages persist when different coordinate methods are trained to comparable convergence or matched reconstruction quality, rather than for fixed training budgets?
- Given the mixed results for label detection and steering, what practical use cases do the authors consider most promising for RC-DS features beyond gain-free reconstruction?
- How well do the observations extend to larger language models, different SAE architectures, or representations with substantially different readout spectra?