- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates and compares the success rate of co-folding with varying depth (more samples in the diffusion step) and breadth (just more random seeds).
Critical strengths
Highly significant research questions that everyone wants answered. This comparison (broad vs. depth) requires substantial computing resources, and this paper did so and found meaningful implications for the community.
Critical weaknesses
The findings and conclusions are somewhat incremental. For result 4.1: We all already know that the DockQ score increases with more seeds (it's already well provided in the AF3 paper). For result 4.2, we all already know that more seeds/more samples will increase diversity (because folding is stochastic). The difference between broad and deep strategy in Fig 3 is not significant. For result 4.3, it's again obvious that the success rate increases with more diverse co-folding structures and poses.
This paper's strongest claim would be "full-cohort oracle discovery numerically favored depth" or " additional sampling can reduce confidence-selected success, and full-pool oracle discovery numerically favors depth". This claim is not well supported by experiments. The reported 95% interval includes zero. This does not establish that deep strategy is better than broad.
Questions for authors
After this huge investigation, the findings somewhat reconfirm what we already know. Is there any strategy to combine both breadth and depth and identify the best sweet spot that increases the success rate within the same budget?