- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper targets de nove peptide sequencing with transformer models. A key gap the paper observe is that current model generates the sequence in one step, and lack mechanism mimicing the "thinking" behavior of modern autoregressive model like LLM. This is partly due to the nature of peptide sequence, where thinking cannot be explicitly represented. Hence, the authors propose a way to artificially construct the "thinking" sequence, or as they termed <reflect> tokens to assemble a thinking process for these transformers. Specifically, they construct miss-by sequence and insert a <reflect> tokens on where the miss happens, urging the model to think twice on the last token. The empirical shows that after such training, the model is able to obtain much better results.
Critical strengths
The empirical evidence is strong. Practicaly, this method is easy to implement, and no RL needed for training like existing thinking model for other autoregressive model (although RL seems highly reasonable, where one first warm up with this <reflect> format, and use RL to keep improving).
Critical weaknesses
-
The concept is not new. This reminds me of [1], where mistakes are injected during pretraining and see if the model can realize that by itself. Moreover, compare to existing approaches, this one seems particularly limited, having <reflect> right after the potential mistakes means that the model can only realize mistakes happend in the last token. The model might be capable of detecting mistakes few steps earlier, but his formulation blocked that. Since you need to do data construction anyway, more general method like injecting multiple <reflect> to represent longer reflect process can all be considered. I think the current idea is nice, but just too many loose end on why this is "the" approach.
-
From the paper, the self-correction does not fire very much, this fundamentally discredit the claim. Also even the among the fired ones, only few actually resolve the mistake.
[1] Ye, Tian, et al. "Physics of language models: Part 2.2, how to learn from mistakes on grade-school math problems." International Conference on Learning Representations. Vol. 2025. 2025.
Questions for authors
-
Do you have a more finegrained statistics on mistakes and <reflect> fire rate?
-
Can you try just train something like multiple <reflect> tokens?
-
Is RL applicable? I feel the current stage is like the warm up stage, and an RL might bring up the success.