- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
In general, this paper wants to solve the problem of sequential selection among a finite set of protein variants, aiming to identify more meaningful variants within a limited budget. The authors propose a method called RESOLVE, which performs different selection steps using a shared backbone. They validate the effectiveness of the proposed method across several tasks and show some good results; I think the experimental evaluation is comprehensive.
Critical strengths
The experimental evaluation is comprehensive, covering multiple tasks and settings; the proposed method demonstrates effectiveness, yielding improvements and gains over the baseline approaches.
Furthermore, the research problem of this paper is clearly defined, and variables were well-controlled.
Critical weaknesses
The proposed method may be overly complex and lacks comparisons with simple baselines (or compute-matched baseline); the authors should analyze and justify whether such a complex control system is truly necessary (or at least give some discussion).
Furthermore, I suggest that the authors provide a detailed discussion and analysis regarding the various components and the selection of hyperparameters (and the reasons), which might benefit their work.
Questions for authors
See Critical Weaknesses and,
-
Can the authors report the actual costs—specifically, whether the performance gains of the proposed method come from increased computational complexity and higher costs?
-
Is there a compute-matched baseline?
-
Could you further elaborate more on the independent contribution of the controller?