- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper establishes a new metric, the redistribution sensitivity score (RSS). The score tests/selects features whose activation changes relative to the clean prompt are large, recurrent, and directionally consistent, such as when adding unnecessary context. The MeanRSS summarizes the average magnitude of the absolute change in the selected features. The main experiment is conducted across 27 SAEs of 5 model families. They test if the selected support set still holds under a held-out validation variant. Finally, a linear probe contribution analysis demonstrates how response magnitude, readout coefficients, directional alignment, and clean margin affect a fixed readout.
Critical strengths
Very detailed method section
The paper provides a very detailed description of how their method works, with additional proofs in the Appendix. The downside is that, because of the extensive formalism, the section is sometimes hard to follow. However, I would not treat that as a weakness.
Extensive experiments
The experimental design covers up to 27 SAEs that are evaluated (Sec. 4.1) and more in-depth ablations on 2 SAEs (Sec. 4.2-4.4). Additional analysis is also included in the Appendix. The thorough testing and variety of SAEs strengthen the evidence that the reported patterns are robust across the evaluated configurations.
Critical weaknesses
Underdeveloped scientific interpretation and significance
Although the experiments and their results are extensive, their discussion and interpretation remain underdeveloped. Currently, Sec. 5 summarizes the results but does not sufficiently put them into context, e.g., what does RSS mean for SAEs, or how will it shape future work related to SAEs and/or mechanistic interpretability? This also ties back to the introduction, where, to me, it was unclear why we were establishing a new metric, which made the initial pass at the paper hard to understand. The discussion of limitations is currently insufficiently developed, a more explicit discussion of limitations and implications would be valuable. My central concern is therefore not the number of experiments, but the lack of a clear connection between the measured phenomenon and a clearly articulated scientific takeaway.
Reproducibility
In some parts, e.g., Sec. 4.1, details for reproducibility are missing, such as the dataset creation. Appendix S3 states that 1000 prompts are generated, but no system/user prompt is given. The paper describes the model used, temperature, acceptance criteria, and high-level transformation descriptions, however, how exactly the different variants of a prompt are created/transformed is not specified.
Questions for authors
Clarification
- How does monosemanticity relate to representation redistribution, and how does RSS position itself relative to monosemanticity metrics, e.g., FMS [1]? Are those complementary measurements? What can RSS tell us about the quality of an SAE?
- In Fig. 2, the Pythia SAEs seem to be outliers, especially for "Irrelevant context" and "Metalinguistic wrapper." Is there a reason why this is the case? How should this pattern be interpreted, and is there evidence explaining the difference?
- Could the authors provide the creation details of the dataset used in Sec. 4.1 and also provide some samples for comparison? How were the acceptance criteria applied?
[1] Härle, Ruben, et al. "Measuring and guiding monosemanticity." NeurIPS (2025)
Dear Reviewer frGi,
We would like to respectfully offer a reminder and invite you to join the further discussion. We believe that most concerns have been reasonably addressed or substantially resolved. If you have a different view, we can give further clarification. Alternatively, we would also welcome you to raise the score or adjust the confidence.
We would also like to share important new experimental results that may change your view of the paper. Following your suggestions, we substantially extended the functional evaluation across models, readout configurations, and data splits to establish the broader significance and reliability of RSS.
We have additionally clarified the model selection protocol, evaluated variability across converged data splits, and simplified the theoretical presentation.
Full experimental details are provided in our responses and revision. We look forward to your reply and will be happy to answer any further questions.