- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SAE-STM, a model for interpretable pairwise preference prediction that combines a sparse autoencoder with a structural topic model. The SAE extracts sparse features from response embedding differences, which condition both the topic encoder and the prior of a ProdLDA model. The topic model reconstructs differences in word usage between responses, while a classifier predicts preferences using only the inferred topic proportions. To interpret these topics, the authors generate natural-language descriptions of associated SAE features and validate them against separate LLM annotations. Experiments cover six preference datasets and four topic granularities, evaluating predictive information through linear probes and the usefulness of topic traits through an external LLM judge. The paper reports complementary information in topic and SAE representations and trait-based preference prediction accuracies of approximately 53–74%, with substantial variation in feature interpretability across datasets
Critical strengths
-
The model combines sparse features with a topic bottleneck, providing both topic keywords and associated feature descriptions for inspecting preference predictions. This offers a useful way to organize otherwise unstructured SAE features.
-
The evaluation covers six preference datasets and four topic granularities, examining both predictive information and the usability of natural-language descriptions. The variation across domains provides useful evidence about where the approach works and where its explanations become less informative.
-
Feature descriptions are checked against separate examples rather than supported only by selected illustrations. The paper also acknowledges cases where validated features capture surface style rather than the substantive preference factors of interest.
Critical weaknesses
-
The explanation evaluation does not establish fidelity to the model’s predictions. Recovering human preferences with an external LLM differs from explaining the classifier, which uses all topic proportions rather than only the dominant topic. Comparisons with generic or shuffled traits are also missing.
-
The reported complementarity gains are difficult to reconcile across evaluation settings. The main text emphasizes substantial gains, while Appendix B reports only a small average improvement on held-out test data, and Appendix H acknowledges probe overfitting. The main results’ evaluation split and configuration need clarification.
-
The contribution of SAE conditioning is not cleanly isolated. The no-SAE baseline also removes preference supervision, so its weaker performance cannot establish the benefit of the proposed coupling. A supervised topic model without SAE conditioning would provide a more informative comparison.
Questions for authors
-
How faithfully do the dominant-topic traits explain the classifier’s predictions? Can you evaluate agreement with the classifier and compare against generic or shuffled traits?
-
Which splits and SAE configurations produce the gains in Tables 2–3? How do these results relate to the smaller held-out gains in Appendix B and the probe overfitting noted in Appendix H?
-
Does SAE conditioning improve prediction or interpretability over the same supervised topic model without the SAE, while retaining the preference classification loss?