- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses spatial fragmentation of visual concepts learned by SAEs. The authors propose the Markov-Field Linear Representation Hypothesis, which models spatial dependencies by decomposing sparse codes into smooth and innovation fields. Based on this hypothesis, they introduce SPATIAL-SAE, which incorporates spatial regularization into SAE training. Experiments on synthetic and real-world vision representations demonstrate improvements in concept recovery on synthetic data and in spatial coherence and interpretability on vision representations.
Critical strengths
- The paper is grounded in a solid theoretical framework and supported by systematic synthetic experiments and real-world evaluations. Overall, the work appears rigorous and reflects substantial effort in both methodology and experimental validation
- Distinguishing between smooth and innovation fields to account for the spatial characteristics of visual representations offers an interesting and novel perspective on SAE-based concept discovery
Critical weaknesses
1. The benefits and limitations of spatial regularization remain unclear
- The paper demonstrates improvements in segmentation alignment and interpretability evaluations. However, it remains unclear whether these improvements primarily reflect better spatial localization of existing concepts or improvements in the learned representations themselves (e.g., novel concepts, finer-grained concepts, or fewer duplicated concepts.) . If the main benefit is improved activation maps, simpler post-hoc approaches, such as smoothing or segmentation-based refinement, might achieve a similar goal without modifying SAE training. The value of incorporating spatial structure directly into SAE learning could be better established.
- SAEs can capture diverse visual concepts, including textures, patterns, and abstract semantic properties that do not necessarily exhibit spatial smoothness. The proposed spatial prior may favor spatially coherent concepts at the expense of others. An analysis of which concepts are better captured, newly discovered, or potentially lost compared with conventional SAEs would clarify the scope and limitations of this inductive bias
2. The semantic significance of the smooth and innovation decomposition remains unclear.
- The ablation studies and spectral analyses support the effectiveness of the two-stream formulation and demonstrate differences in spatial frequency characteristics. However, they provide limited insight into the semantic information represented by each field. A more direct analysis of the concepts captured by the smooth and innovation fields would strengthen the empirical support for MF-LRH.
Questions for authors
-
However, what types of visual concepts are captured by the smooth and innovation fields, respectively? Could the authors provide concrete examples showing whether they capture complementary semantic information in real-world representations?
-
How does SPATIAL-SAE change the types of concepts learned compared with conventional SAEs? Are there concepts that become newly identifiable or better represented, as well as concepts that become less interpretable due to the spatial prior?
-
Could the authors summarize the absolute improvements in MCC, support F1, and polysemanticity for each sparsifier in Table 1? Currently there is only win rate are reported, and this additional info would help assess the magnitude of the gains
-
The synthetic benchmark varies the geometry and support of smooth and innovation fields. How representative are these assumptions of real vision-model representations, and would the proposed method remain effective when the underlying concepts exhibit different or weaker spatial dependencies?
7 comments
Rebuttal 2/2
W2.a / Q1: [...] a more direct analysis of the concepts captured by the smooth and innovation fields would strengthen the empirical support for MF-LRH. [...] What types of visual concepts are captured by the smooth and innovation fields, respectively? Could the authors provide concrete examples showing whether they capture complementary semantic information?
TLDR: The smooth field carries the concepts; the innovation field carries the residual: fine local detail and noise. Reconstructing from the smooth field alone keeps 94 to 99% of the concept information (linear-probe segmentation F1) of the full reconstruction. The innovation field alone keeps little, and adding it helps mainly at object boundaries, so the two fields are complementary.
In particular, we applied the segmentation probe from our reply to NVWv Q1 to each stream's reconstruction on its own:
- Concepts sit in the smooth stream: its reconstruction recovers 94 to 99% of the full reconstruction's segmentation F1, while the innovation stream alone recovers little (F1 8-16 vs 41-45).
- The innovation stream adds local detail: adding it to the smooth stream raises F1 more on boundary patches than inside objects, for every sparsifier and seed (+0.4 to +3.1pp vs 0.0 to +0.8pp), and it specializes in high frequencies (Figure 6c, dotted), the band that contains boundary detail (our reply to NVWv W2).
Furthermore, this split is what signal processing predicts. The innovation field specializes in high spatial frequencies (Figure 6c), the band with the lowest signal-to-noise ratio: natural signals concentrate their energy at low frequencies while noise spreads across all of them [1, 2], also on graphs [3].
We will revise Section 1 and Appendix B.3 to describe the innovation field this way, and add a gallery of randomly sampled smooth and innovation stream features with their descriptions to the appendix.
[1] Donoho, David L., and Iain M. Johnstone. "Ideal spatial adaptation by wavelet shrinkage." Biometrika, 1994.
[2] Wiener, Norbert. "Extrapolation, interpolation, and smoothing of stationary time series." MIT Press, 1949.
[3] Shuman, David I., et al. "The emerging field of signal processing on graphs." IEEE Signal Processing Magazine, 2013.
Q4: [...] How representative are these assumptions of real vision-model representations, and would the proposed method remain effective when the underlying concepts exhibit different or weaker spatial dependencies?
TLDR: The synthetic data reproduces the spatial dependence of real activations, and the gain persists when that dependence is weaker. Our generator matches the spatial dependence measured in DINOv2 (the decay of patch similarity with distance), and Spatial-SAE's gain in concept recovery (support F1) over the baseline stays positive for every sparsifier as the dependence weakens.
In particular, Figure 2c shows the offset-similarity kernels of real DINOv2 activations, and Figure 2d shows that our generator reproduces their decay with distance, while an independent (LRH) model does not. To test weaker spatial dependence, we lower , the diffusion strength that sets how far each smooth concept spreads over the grid, from 64 to 4. With a smaller each concept covers fewer patches, so neighboring patches share less of their code. Cells are in F1 (pp), in bold where Spatial-SAE is better:
| Sparsifier | Strong dependence () | Weak dependence () |
|---|---|---|
| TopK | +4.5 | +4.3 |
| BatchTopK | +9.2 | +8.1 |
| ReLU | +0.4 | +0.6 |
| JumpReLU | +6.5 | +2.7 |
Thank you for the detailed rebuttal and additional experiments. I appreciate the authors' efforts,
However, my concern about the limitations of the spatial prior remains. The current evaluations mainly focus on segmentation-based concept alignment, which naturally favors spatially localized concepts. While the additional class-wise analysis clarifies the trade-offs across object sizes, it does not address whether spatial regularization comes at the cost of learning other types of visual concepts, such as textures or abstract attributes (e.g., emotions, actions), that may not exhibit the same spatial structure. Comparing image-level concept identification performance against standard SAEs on classification datasets could help clarify this potential trade-off.
Rebuttal 1/2
We thank the reviewer for the thoughtful questions about what the prior changes. We answer in order of importance.
TLDR: The learned representations themselves improve, and post-hoc smoothing cannot reproduce the gain. On real data, smoothing a baseline SAE reaches Spatial-SAE's semantic smoothness (region coherence), yet its concept quality (Normalized F1) is lower than Spatial-SAE's for all four sparsifiers. On synthetic data, where the true concepts are known, this gain is evident: Spatial-SAE directly improves the quality of the learned concepts as measured by their alignment with true concepts (MCC), which no post-processing of activation maps can change.
Smoothing control on real data (the same table as in our reply to NVWv W1). We smooth each baseline's codes with a Gaussian kernel of one patch (the best of six smoothing kernels for concept quality), re-sparsify every patch to its original ℓ0, and decode with the baseline's own dictionary. Cells are ΔSpatial−smoothed, in bold where Spatial-SAE is better:
Synthetic data, with the absolute gains of Table 1 (Q3). Spatial-SAE improves all three identification metrics for every sparsifier: clearly for TopK, BatchTopK, and JumpReLU, and slightly for ReLU. For those three, relative to the baseline, alignment with the true concepts (MCC) rises by 10 to 21%, support recovery (F1) rises by 25 to 83%, and polysemanticity falls by 21 to 51%. Cells are the mean ΔSpatial−baseline over the 300 matched pairs of Table 1, with the change relative to the baseline in parentheses, in bold where Spatial-SAE is better:
TLDR: Concepts that span many patches gain the most. For TopK, gains do not depend on object size; for the other sparsifiers, small, thin objects can lose.
We compared each class's best-feature F1 between baseline and Spatial-SAE (the 84 ADE20K classes with at least 10 held-out images):
With TopK, small classes gain on average (+2.7pp), so the loss is not inherent to the prior. Under MF-LRH, small objects should be captured by innovation features, but in our trained models these act mainly as a local residual at object boundaries (our reply to W2.a), so for the other three sparsifiers no feature matches small objects as well as the baseline's best one. We will discuss this in the limitations.