- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper concerns the problem of steering a protein language model. The challenge is that current approaches for steering language models cannot reliably produce coherent sequences that also satisfy the factor that is being steered. Overall the paper used a filtering approach (based on Mahalanobis distance) for identifying structurally plausible sequences.
Critical strengths
- The paper demonstrates a very concrete failure that is induced by guidance and steering. Of course, prior work showed this too. However, here this paper finds the representation signature: i.e, that guiding activations leads to activations for random amino acids. They show the failure applies to multiple guidance methods.
- They show that optimizing a property predictor can reward degenerate sequences.
- Their detection is very simple, and might be more commonly adopted in the future.
Critical weaknesses
The novelty of work is quite limited. I outline how I see it:
- Activation steering is already well known, the difficult of steering coherently is also well known, filtering is also well known. In fact, there are previous works on sparse autoencoders and proteins, and steering protein language models.
- It would be important to see whether activation-based filtering matches or outperforms their proposed approach.
Questions for authors
- Frey et al. (ICLR 2024), Protein Discovery with Discrete Walk-Jump Sampling, used a distributional conformity for evaluating generated proteins. How does the proposed Mahalanobis filtering compare with the Distributional Conformity Score as a measure of biological plausibility? In particular, does activation-space typicality detect implausible guided generations that sequence-level distributional conformity measures fail to identify?
2 comments
Dear Reviewer,
We would appreciate any feedback on our rebuttal and whether it addresses your concerns. We would be happy to clarify any remaining questions.
Thank you for your time and consideration.
We thank the reviewer for recognizing the representation level failure and the possible utility of a simple detector. We agree that activation steering and post-hoc selection are established techniques, and will make the related protein steering and representation analysis literature more explicit.
W1–W2. Novelty and comparison with alternative activation-based methods
We thank the reviewer for highlighting prior work on protein activation steering and sparse autoencoders which provide valuable insights. Our contribution is not a new steering algorithm or the general idea of filtering, but the identification and characterization of a specific failure mode in guided protein generation.
As shown in Fig. 3, stronger steering causes protein representations to contract toward the natural protein mean, approaching the radial regime of random amino acid sequences, even as the predicted target property improves. We further observe this inward contraction under predictor gradient guidance, indicating that it is not limited to vector steering.
This finding motivates our Mahalanobis filter: a simple, training-free diagnostic specifically designed to detect inward representation collapse.
To test whether other activation-based methods provide similar filtering performance, we compared alternative representation scores on the same 3,454 generated sequences at matched retention rates.
Table 1. Comparison with alternative activation based filtering methods.
M achieves better selection quality than the tested simple activation distance baselines and performs competitively with the learned GLP prior. At 20% retention, M improves mean pLDDT over GLP typicality (63.0 vs. 57.3), while at 50% retention their performance is nearly identical.
Unlike GLP, our method requires no additional model training and uses only precomputed activation statistics.
SAE reconstruction error performs comparably at 50% retention (53.2 vs. 53.1), but M performs better at 20% retention (63.0 vs. 57.9) without requiring auxiliary model training.
Together, these results support our central contribution: a specific representation level failure signature that can be detected efficiently and used to improve the selection of guided protein sequences.
Q1. Comparison with Distributional Conformity Score (DCS)
We thank the reviewer for pointing out Frey et al. (ICLR 2024). DCS measures conformity to a reference distribution through the joint density of protein properties.
We evaluated DCS at matched retention rates using UniRef50 reference sequences and the released conformity score procedure. To ensure a meaningful comparison, we tested both a physicochemical feature implementation and an Appendix F style adaptation using the three transferable features from the original paper. We further strengthened DCS by incorporating PLM pseudo perplexity into the joint density, as permitted by its original formulation.
Table 2. Structure confidence selection using Mahalanobis and DCS.
M outperforms even the strengthened DCS variant at 20% retention. The two methods also identify substantially different candidates: for the 27 feature DCS adaptation, their top 20% selections overlap by only 28.7%. Candidates selected exclusively by M achieve higher ESMFold pLDDT than those selected exclusively by DCS (61.2 vs. 45.1).
Table 3. Structural confidence of candidates selected by only one method.