- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes using one functional request to drive the whole design. The user says what the protein should do and under which conditions, and the same request both steers which sequences get generated and selects the final one. The state-contrast part is supported by theory, but the gains are small compared to the baselines.
Critical strengths
- The control is clean and the mapping from concentration to simplex weight is a nice idea.
- The technical evaluation is careful and negative results are also reported.
Critical weaknesses
- The main baseline compares a model trained on the assay against inverse-folding likelihood which was never meant to predict a concentration-dependent response. It mostly shows that a supervised predictor helps.
- The pool comparison is against random, which is a floor and not a real baseline, and the fixed-concentration test only works in one of the three target groups. The main novelty provides the weakest numbers.
- ProteinMPNN outerforms their own pool on their own task, and under the matched protocols it wins everywhere. Two of the other conformational sources also have better point estimates.
- On the motif transfer the target likelihood drops while the direction margin grows. That can mean the model is just pushing the two states apart without actually fitting the requested one better, and nothing in the paper separates these two cases.
- Boltz-2 numbers/plot are never reported.
- Diversity and novelty are never looked at as the request changes.
Questions for authors
- How does the error change as the budget goes from 1 to 19? Somewhere in between the request effect should disappear, and it would help to see where.
- Could you show the preference against the request weight directly, instead of only the slope gains? I would like to see if the response is smooth or driven by the endpoints.