- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies how reconstruction fidelity should be interpreted when a representation learned on a source distribution is evaluated on a different target distribution. The authors argue that a single reconstruction score, such as explained variance or fraction of variance unexplained, is insufficient under distribution shift because it conflates three distinct factors: the reference predictor used in the metric, the mismatch between the reconstructed and target means, and the ability to capture variation within the target distribution.
The paper provides theoretical results for convex reconstruction sets, together with a more extensive empirical study. In particular, it argues that a negative mean-referenced reconstruction score does not necessarily imply an absence of target-centered structure: reconstructions may capture some relative variation in the target while being globally misplaced in the representation space.
Critical strengths
- The paper is generally easy to follow. The explicit discussion of “what is classical and what is new” in the introduction is particularly helpful for positioning the contribution. The motivating issue of negative reconstruction scores is also introduced clearly and compellingly.
- The running example is effective: it makes the successive theoretical quantities and empirical observations easier to interpret.
- The paper raises a relevant and well-motivated issue for reconstruction-fidelity metrics under distribution shift. Its recommended reporting practices could be useful for future work on dictionary learning and sparse autoencoders.
- The experimental protocol appears careful. In particular, the use of group-disjoint splits, matched held-out-self baselines with equal capacity, numerical verification of signs, group-level bootstrap intervals, and structural controls strengthens the empirical study.
- I appreciate that the paper does not overstate the novelty of the central decomposition, and clearly acknowledges its relationship to classical error decompositions.
Critical weaknesses
- The central decomposition is explicitly classical. The main novelty therefore lies in its framing for reconstruction under distribution shift, the convex-set bound, and the empirical analysis. This is not necessarily a problem, especially since the paper is transparent about it, but it limits the conceptual novelty relative to a paper introducing an entirely new theoretical decomposition.
- The strongest theoretical results apply to convex reconstruction sets and do not directly cover standard sparse autoencoders.
- The SAE study is limited to Gemma 2 2B, Gemma Scope SAEs, three layers, and five text distributions whose genuinely out-of-distribution character is not established. As a result, this part currently reads more as an illustrative application of the fixed-map decomposition than as a sufficiently broad investigation of SAEs under distribution shift.
Special Note: I did not verify the mathematical proofs, as this is outside my area of expertise. My assessment focuses on the novelty, methodological design, and empirical evaluation. I would therefore encourage the Area Chair to ensure that at least one reviewer has carefully assessed the correctness of the theoretical results.
Questions for authors
- Can an analogue of the proposed geometric certificate be developed for standard SAEs or other non-convex reconstruction maps?
- To what extent do the conclusions change after centering, whitening, or otherwise reducing embedding anisotropy? In particular, how much of the observed importance of the location term is specific to L2-normalized text embeddings with high centroid mass?
3 comments
Ok thanks for your reply, that's seems good for me, I keep my accept.
Thank you for reading our response and for confirming your assessment. We are glad it addressed your questions. If anything still holds the paper back in your view, we would be glad to address it before the discussion closes.
Non-convex SAE bounds, shifted SAEs, and whitening
Thank you for the review and the note to the AC (our General Response gives a four-step proof of Theorem 1 for that purpose). Short answers first:
The decomposition is "explicitly classical"
Agreed—and keeping that boundary explicit is central to the paper. Beyond the classical split, we contribute the weight-free convex-set bound and sign certificate, Proposition 2's four-term hull split, the fixed-shape translation control, and cross-regime empirical evidence.
The theory does "not directly cover standard sparse autoencoders"; can an analogue of the certificate be developed?
A map's mean reconstruction lies in the closed convex envelope of its outputs; for non-negative codes, that envelope sits inside bdec plus the cone of decoder directions, so the normalized distance ρ(∞) to that cone bounds ρ^ without target codes (Proposition 3, Appendix J.4). Translated fit RST2 does not carry over because re-optimizing in the envelope changes the encoder (Section 10). Across dictionaries (Table J.3):
The SAE study is narrow, and the "genuinely out-of-distribution character is not established"
Centering, whitening and anisotropy; L2 normalization and centroid mass
Every arm applies one shared transform, fitted on the source or on fourth corpus PFG, to both sides (Table J.1; centering each corpus on its own mean uses the target mean and removes location directly, Appendix B.1).
Does this answer your second question as you meant it?