- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper questions the common practice of evaluating sparse dictionary models, such as sparse autoencoders and crosscoders, with pooled explained variance (EV). The authors show that pooled EV can be rewritten as a weighted average of per-token reconstruction scores, where each token's weight is proportional to its squared distance from the activation mean. As a result, a small population of high-norm tokens, which several vision encoders develop, can dominate the score and hide poor reconstruction of the remaining tokens. To expose this, the authors introduce masked, token-balanced, and norm-decile EV and use them to evaluate crosscoders trained on five VLM vision encoders. They further show that reconstructions with near-perfect pooled EV can still degrade SpatiaLab accuracy when substituted back into the encoder (by up to 6.9 percentage points in Qwen2.5-VL), and they analyze the MLP contributions that produce the high-norm tokens.
Critical strengths
S1. The paper pinpoints a practically important issue in how sparse representations are currently evaluated. Figures 1 and 2 convincingly show that the issue arises in practice: in Qwen and LLaVA, the highest-norm decile accounts for over 96% of the variance at late blocks, and raw EV diverges sharply from the masked scores once these tokens emerge.
S2. The experiments cover six vision encoders from different VLM families, which seems to be sufficiently thorough.
Critical weaknesses
W1. Presentation and clarity.
(a) Abstract framing. The sentence "However, their use for comparing blocks within a single vision encoder remains underexplored" does not reflect the paper's main contribution. As I understand it, the paper examines the EV-based evaluation scheme rather than extending crosscoders to blocks within a single vision encoder. The sentence also does not connect to the next one, and "this limitation" in the following sentence has no clear referent. The abstract would benefit from a careful revision so that the motivation leads directly to the research question.
(b) Introduction of EV. The introduction turns to pooled EV without explaining why EV is relevant. I assume this is because sparse representations are commonly evaluated with EV, but this should be stated explicitly, together with what "pooled" means, before the weighting issue is raised.
(c) Description of the crosscoder. Section 2.1 is too brief to understand how the crosscoder is trained and how it is used in the experiments. In particular, the training objective (currently Eq. 5 in the appendix) and the fact that block replacement uses the full clean activation stack, including later blocks, should be described in the main text.
(d) Reliance on the appendix. Sections 4.4 and 5.2 draw conclusions from results that appear only in the appendix (Appendix A.4 and Table A18, respectively). If these results are discussed in the main text, they should also be presented there.
W2. Unclear recommendation among the proposed metrics. The paper introduces three alternative metrics but does not clarify which one future work should adopt. Moreover, the metrics can disagree with each other: for Qwen in Figure 2, token-balanced EV remains high while masked EV is low. The authors explain that the metrics answer different questions, but practitioners still need guidance on which metric to rely on when they conflict, ideally supported by evidence of which metric best predicts behavioral degradation.
W3. Connection to the main claim and novelty of Section 5. Since the main claim is that pooled EV can misrepresent reconstruction quality, the role of the mechanism analysis in Section 5 is unclear. The authors themselves note that these interventions measure norm contrast and do not test their effect on crosscoder fidelity. In addition, the role of MLPs in producing high-norm tokens has already been studied by Jiang et al. (2025) [1], who localize it to a sparse set of neurons. The additional contribution of this analysis is therefore unclear.
[1] : Nick Jiang, Amil Dravid, Alexei A. Efros, and Yossi Gandelsman. Vision transformers don’t need trained registers.
Questions for authors
Q1. Have the authors tried removing the high-norm tokens with the test-time registers proposed by Jiang et al. (2025) [1] and then re-evaluating the crosscoders? It would be informative to see (i) whether the discrepancy between raw EV and the proposed metrics shrinks, and (ii) whether, at the same sparsity, typical-token fidelity and downstream VLM accuracy improve. Such an experiment would also connect the mechanism analysis in Section 5 to the paper's main claim.
[1] : Nick Jiang, Amil Dravid, Alexei A. Efros, and Yossi Gandelsman. Vision transformers don’t need trained registers.