- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The work proposes Evok, an evidence-centric multi-agent framework for GPU kernel optimization. The key idea is to preserve prior optimization experiences as structured evidence. It features evidence-guided staged optimization, which decomposes generation into route planning, candidate realization, and local admission. In this way, the reusable optimization opportunities can guide exploration under target-local validation. Another point is the multi-agent collaboration that enables specialized agents to accumulate, refine, and exchange validated optimization evidence. Experiments on KernelBench across three GPU platforms report speedups over PyTorch and improvements over existing LLM-based kernel generation systems, including EGG and CudaForge.
Critical strengths
-
This paper tackles GPU kernel optimization which is important. Evidence-based method is motivated.
-
The framework proposes a way to structure and exchange successful optimization experiences.
-
The empirical results are promising compared with other approaches.
Critical weaknesses
-
Limited methodological novelty compared to existing agentic kernel optimization frameworks. EGG is closely similar, and this is not the first multi-agent system. As far as I know, https://arxiv.org/pdf/2509.07506 this paper seems to be the first multi-agent system, and K-search https://sky.cs.berkeley.edu/project/k-search/ and AccelOpt https://arxiv.org/pdf/2511.15915 also use memory / evidence based approach. Also the papers that they mentioned and cited should be considered as well. I would appreciate if the authors could read more about the work and clarify the distinction.
-
The fairness of the experimental comparison is a concern. Do all methods in comparison receive the same token / money budgets? Matched search/inference budget can make the comparison more convincing.
Questions for authors
Please see the weakness parts.