- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies the translation problem from protein sequences to their corresponding codon sequences given a particular species. Specifically, this paper proposes PINATA, which leverages MSAs, encoded into a hand-engineered 34-dimensional matrix from related species to guide prediction. PINATA is trained in a similar way as masked language model with additional supervision on matching the properties of native species. In evaluation, PINATA is shown to predict codon sequences that match the properties of native species better than existing baselines.
Critical strengths
The paper studies an important field that connects protein sequences with codon sequences, which has impactful applications in drug discovery. The paper explicitly takes MSA into the modeling which is novel.
Critical weaknesses
I'm not convinced by the evaluation because the evaluation metrics are part of the training loss of PINATA. Therefore, it is not surprised that the PINATA predict codon sequences that match the properties of native species and it is unable to tell if the improved performance is from the direct signal of supervised training or adding evolutionary information from MSA.
Questions for authors
-
The evaluation metrics are the same as part of the loss function. Could the authors conduct another ablation study to remove those property loss and only keep the reconstruction loss during training?
-
The paper extracts a 34-dimensional matrix from MSA. Why don't apply another transformer on the raw MSA directly without using hand-crafted features? Moreover, the similarity between species are not taken into account in the MSA statistics, which are important evolutionary information. The performance of learning-free MSA is only slightly worse than PINATA, which indicates that modeling raw MSA directly might be more effective.
-
What downstream applications that PINATA can do beyond predict codon sequences that match the properties of native species?