- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates the organization of Mandarin lexical tone in self-supervised speech representations using label-blind TopK sparse autoencoders. Results show that tone-selective features frequently transfer across syllable types and recur across independent fits, but stable sparse localization is uneven and strongest for T3. While the 64 selected sparse features retain ~80% of the full-state above-chance macro-recall gain, their decoder span retains ~100%. This gap suggests that tone information is present in the selected representational geometry but is incompletely exposed by sparse activations, consistent with a feature-absorption account in which tone evidence is distributed across context-dependent features rather than reliably localized in individual sparse coordinates.
Critical strengths
- Well-constructed Research Questions: they decompose multiple claims that are often conflated.
Critical weaknesses
- The motivation for Mandarin as the linguistic target could be better justified. Although Mandarin is one of the most widely spoken languages, other tonal languages should still be tested to demonstrate novelty.
- The terms “reusable feature” and “feature absorption” seem to be too strong for what is demonstrated. The experiment results do not support those phenomena at this point.
- While this paper may be valuable for analyzing Mandarin lexical tones in SSL models, its current framing and contribution are not well aligned with ICLR’s focus. It would be better suited for domain-specific venues such as Interspeech.
Questions for authors
- See Critical Weaknesses.
- The current version of this paper omits several details, for example, (1) F0 in the main text and in the caption of Figure 1. (2) Mandarin phonological components such as “initial–final types”. Can the authors further clarify the definitions or provide examples of those missing parts for better clarity and readability?
6 comments
Dear Reviewer e7CL,
We would appreciate it if you could take another look at our rebuttal, which we hope has clarified some of the misunderstandings underlying your concerns. We welcome your further feedback and hope you will reconsider your evaluation in light of our clarifications and additional evidence.
Thank you for your rebuttal.
W1 & W3. I respectfully disagree with the authors’ stance that “other tone languages would show how far the result extends.” Evidence from another tonal language could help clarify the interpretation of the findings, not just to test whether they generalize. Figure 3(b) shows that consistent SAE-specific selectivity is limited and concentrated in T3: 5 of the 7 model–layer–tone cells with recurrent selectivity advantage over dense controls across 9 refits correspond to T3. The newly provided Appendix Q further shows substantially higher hit rates for the selected broad T3 latent than for the corresponding latents of other tones at the two evaluated model–layer settings.
Therefore, I wonder if the strongest sparse-localization results reflect general properties of tone representations or the combination of acoustic cues associated with Mandarin T3. For example, in Cantonese or Vietnamese, where the relationships between pitch contours, phonation, and tone categories differ, would consistent sparse selectivity extend to categories without comparable phonation cues, or remain concentrated in particular acoustically distinctive categories? Separately, would the gap between sparse activations and their decoder span persist?
W2 & W3. I appreciate the additional diagnostics and the authors’ willingness to revise their interpretation. However, Section 4.5 and Appendices M and Q do not support feature absorption as the explanation for the recovery gap, and Appendix Q explicitly states that the analysis does not establish feature splitting as its mechanism either. The stage-wise analysis usefully locates approximately two-thirds of the gap between the selected encoder and decoder spans and approximately one-third at TopK gating, but it still leaves open why this allocation arises. Although transfer and recurrence support the authors’ operational definition of “reusable,” they should be distinguished from broad category coverage and consistent SAE-specific selectivity. The concentration of the latter in T3 limits the breadth of the positive findings, as discussed in W1 & W3.
Despite these clarifications and additional experiments, my main concerns remain unresolved. Therefore, I will retain my original score.
Rebuttal: Why Mandarin tone, and fit with ICLR
Dear Reviewer e7CL,
Thank you for asking why this case matters and whether it belongs at ICLR. Answering these questions helped us state the motivation and contributions more clearly in the revised Introduction. We hope the answers below address your concerns, and we would be grateful if you would reconsider your assessment.
W1. Why Mandarin, not other tone languages?
Mandarin is chosen because it makes the paper's question testable, not because it is widely spoken. The question is whether a contrast that a model can decode is also organized as a reusable sparse feature. Testing it needs three conditions, and Mandarin meets all three:
The paper's novelty lies in separating decodability from reusable sparse features, not in the number of languages. Prior probing shows that Mandarin tone is decodable, and speech SAE studies examine features for selected concepts (Parra, 2025; Mariotte et al., 2026; Aparin et al., 2026). We ask whether the features for all four tones transfer to unseen syllables, recur after refitting and together recover the inventory. They transfer and recur, but their sparse activations recover the four tones less well than the span of their own decoder directions, in all 36 strict comparisons. So decodability, a transferable feature and complete inventory recovery are different claims that need separate evidence.
Other tone languages would show how far the result extends. They would not change what the Mandarin case already shows, namely that decodability and reusable sparse localization can come apart in the same representation.
W2. Are "reusable feature" and "feature absorption" too strong?
No. Both terms are used in a narrowly defined sense, and the revision tests the second one directly. "Reusable feature" is the property the paper sets out to test, as its title indicates, and it asks for more than decodability. A feature must also transfer to unseen contexts and recur after refitting, and Sec. 3.2 tests both. "Feature absorption" was presented in the original submission as a hypothesis consistent with the recovery gap, not as a demonstrated mechanism.
Reusable feature. Sec. 3.2 defines it by two tests: a selected feature transfers to initial–final types excluded from fitting, and the same tone-selective function is rediscovered after independent refitting. Of 432 evaluations, 321 exceed test AUC 0.55, and 37 of 48 model–layer–tone cells stay above chance in all nine refits (Sec. 4.2). The paper also reports where the term stops applying. Only seven cells show an SAE-specific advantage over dense controls in every refit, five of them T3.
Feature absorption. It is the hypothesis that category evidence is carried by more specific, context-conditioned features rather than by one category-selective feature, as proposed for language-model SAEs (Chanin et al., 2025). The revision tests it directly (Sec. 4.5; App. Q). Tone-probe evidence is spread over many latents whose identity depends on syllable type, but these latents fire alongside the broad tone latent rather than replacing it. The result is closer to feature splitting than to absorption proper, and the Disscussion states it (p.9).
W3. Fit with ICLR
The paper is a representation-learning paper that uses Mandarin tone as a controlled test case. ICLR has published the core studies of what SAE features reveal about learned representations (Huben et al., ICLR 2024; Gao et al., ICLR 2025; Leask et al., ICLR 2025). We ask two of their questions for speech SSL models: whether SAE features are stable across refits, and what sparse activations, as opposed to decoder geometry, reveal about a representation.
The central finding concerns SAEs, not Mandarin phonology. The same SAE features expose less information through their activations than their own decoder directions contain (Sec. 4.2), which matters for how SAE results are read in any modality. The paper's primary area is unsupervised and self-supervised representation learning, a core ICLR topic.
Q2. Definitions and examples
The paper defines these terms with examples. Figure 1 shows the four tone contours, with an example syllable for each tone (妈 mā, 麻 má, 马 mǎ, 骂 mà). The Introduction defines F0 as fundamental frequency, the acoustic basis of pitch, and an initial–final type as the pinyin syllable without its tone digit. Methodology terms are defined in Sec. 3.2 (transfer, recurrence, selectivity advantage) and Sec. 3.3 (decoder span, retained above-chance gain).