- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
So this paper studies feature sensitivity on the top K SAEs. You'd have a discussion of the larger K cross on the top K cutoff will cause the active margin prediction paraphrase dropout.
Critical strengths
This paper have a clear and well posted question for the topic of discussion. It also has a good casual isolation of KBS width. It also provided an honest control and negative result that have enough validation and holdout split by source texts.
Critical weaknesses
This paper only included a very tiny and narrative evaluation data that should be expanded more. The repair is trained and evaluated on essentially the same distribution or metric. Therefore, the sensitivity is questionable, proxy for reliability and rarely features may be legitimately brittle.
Questions for authors
How does the sensitivity behave on token level activation and on other layers token position? Is the repair robust to a different paraphrase back translation type or other meaning preserving perturbations?
Thank you for recognizing the clear question, the isolation of k from width, and the source-disjoint controls.
W1. Is the evaluation too small?
We agree that the original evaluation is limited in size and in rewrite style.
We have expanded it: four new rewrite types add 5,038 pairs, on top of the original held-out sources and cross-model checks. The original 856 test sources remain excluded from training and selection, and every method is evaluated on the same pairs. Confirmed details are in Apps. A.10–A.11.
W2. Are training and evaluation essentially the same distribution?
This is a fair question: if we only reuse the same rewrite generator, the test may look too close to training.
Training and testing do not share source texts, and the method still works when the rewrite procedure itself changes, including back-translation. No rewrite of an auxiliary-training or selection source enters the 856-source test set. To go beyond new sentences from the same generator, we change the rewriting procedure without retraining:
Q2. Does it work with another paraphraser or back-translation?
Yes. The submitted loss improves sensitivity on all four new rewrite types below, including back-translation.
Changes in percentage points, paired means±SEM over five retrained seeds; p<0.01 for the submitted loss on all four new types. All five rows use the same encoding pipeline. The last row is a reference that re-encodes the original GPT-4o rewrites, not a fifth new method. AUC measures discrimination against other-source rewrites. Confirmed details are in App. A.10.
Is the evaluation just the training metric, and is sensitivity a reliability proxy?
Sensitivity is not just the training objective restated: we also check false alarms and rewrite types the method never trained on. The property at issue is whether an interpreted feature remains available after a meaning-preserving wording change. This complements reconstruction and coverage, rather than replacing them (Tian et al., 2025; Secs. 1, 6).
Could rare features be legitimately brittle?
Yes, some could be, and Sec. 3.1 already says so: a rare feature may encode a lexical or syntactic detail that a paraphrase can change. The original paraphrases were manually checked for meaning preservation.
Brittleness is possible, but it does not explain away the result: useful stability can be gained without firing indiscriminately. An optional discussion-period term improves per-feature sensitivity while reducing firing on other-source rewrites from 25.6% to 8.8% (Table 6).
Q1. What about token positions and other layers?
Other layers are already covered; token-level position is a different readout from the one this paper evaluates. Table 2 spans seven depths, and Table A.7 repeats the sensitivity check at layers 2, 8 and 10, with a +5.2pp gain at layer 10. Our readout is sentence-level mean pooling (Sec. 5.2; App. A).
We hope our responses address your concerns. If you have any further questions, please do not hesitate to let us know.