- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SAE codes assign feature amplitudes, and people use those amplitudes to rank activating examples, attribute model behavior, and set intervention strengths. Reconstruction objectives do not directly measure whether those amplitudes are accurate. Interference between co-active features can cause sample-dependent amplitude errors that a fixed per-feature rescaling cannot generally remove. The paper asks how to diagnose and reduce amplitude errors that remain even after the dictionary and support (which features are active) are recovered correctly. Contributions: They show that one-pass tied SAE encoders produce sample-dependent amplitude errors even when the dictionary and active support are exactly correct. This separates amplitude errors from dictionary and support errors. They prove that the change in a code after decoding and re-encoding (the self-consistency residual) controls its amplitude error. For tied and untied SAEs, they give local bounds that account for decoder mismatch, observation noise, and conditioning. They propose a self-consistency penalty that can be added to standard SAE training. It costs one extra encoder pass during training, adds no parameters or inference cost, and has a masked variant for TopK encoders. In controlled tied, untied, and fixed-decoder synthetic settings, latent recovery error goes down, with dictionary, support, and amplitude recovery measured separately.
Critical strengths
- Authors provide a clear way to detect amplitude errors while keeping the scope honest 4.1: The paper shows that a tied SAE can get the features right and pick the right active features, yet still report wrong strengths. Overlap between co-active features causes this, and the error changes from input to input. 4.3. Decoding a code and encoding it again changes the code by an amount tied directly to the amplitude error. It needs no ground truth, so it can be applied to SAEs trained on real models. 4.4 . The authors say plainly that the bounds hold at fixed parameters and that training effects are tested empirically.
2.The proposed method is easily implemented and tested in controlled settings 5. The regularizer adds one encoder pass during training and nothing at inference. There are no new parameters and no architecture change. 6.1 Different error types are reported on their own, so the effect on amplitudes isn’t hidden in one aggregate number. 6.2 The fixed-decoder control keeps the dictionary exact and the support correct
Critical weaknesses
-
The paper doesn’t show the regularizer beats alternatives As i understand it, the authors claim any benefit must come from training dynamics, which they don’t explore. Baseline comparisons that would fix this weakness are not there: Least-squares refit on the SAE’s selected features. O’Neill et al. (2025) is cited in Sec. 2 but not compared against
-
The results are weak in some cases 6.2 The synthetic setup is idealized. The data is noiseless.The SAE appears to use the true sparsity level k. The decoder starts near the true dictionary. F.1 The improvements are thinner in over complete settings It’s also unclear whether the baselines are trained to convergence. If not, the large untied gains may reflect faster optimization rather than a better solution. 6.3 Amplitude accuracy is the paper’s whole motivation , yet the GPT-2 experiments never measure it. CE-Bench measures how interpretable features are, not whether their amplitudes are accurate. So even a real gain doesn’t test the paper’s main claim.
Questions for authors
-
Can you show that SC improves amplitude accuracy on real model activations, not only interpretability scores? Report the SC residual and E_coef on the GPT-2 SAEs, with and without SC
-
Do you see the same gains as in the synthetic setting against trained baselines? Does the CE-Bench gain hold against a properly trained baseline?