- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper looks at how a model can learn from past GPU kernel optimization attempts and reuse those techniques on new tasks. The authors propose CORAL, where the same language model takes on three roles: skill selection, kernel generation, and skill summarization. The three roles are trained together through reinforcement learning. The model extracts new skills from successful optimization runs, verifies them through actual execution, and then adds them to a skill library for later tasks. The experiments are mainly on KernelBench. Under three-turn evaluation using the last output, CORAL performs better than the authors' reproduced Dr. Kernel baseline. The ablations also suggest that skill injection and joint training help, though the gains depend on model size, task difficulty, and evaluation protocol.
Critical strengths
1. The problem is practical, and the framework is fairly complete.
GPU kernel optimization is not just about generating correct code. It also involves learning from optimization techniques that have worked before. CORAL brings skill selection, kernel generation, and experience summarization into one reinforcement learning framework, and uses actual execution results to check whether a skill works. The idea of accumulating experience is not entirely new, but I think training the three roles together is still valuable.
2. The results are good, and the paper includes quite a few ablations.
Under three-turn evaluation using the last output, CORAL-14B improves Level 2 Fast₁ from 58.5% to 70.6%, and Level 3 Fast₁ from 22.1% to 32.2%. When the RL losses for Selection and Summary are removed, Level 3 Fast₁ drops to 20.0%, which suggests joint training does help. Also, with fourteen turns and best-output selection, CORAL-8B improves Level 2 Fast₁.₂ from 39.4% to 55.4%. So the method is not only effective under three-turn evaluation.
Critical weaknesses
The performance gains depend quite a bit on the number of search turns and the evaluation protocol.
CORAL-14B shows a clear improvement on Level 3 with three turns and last-output evaluation. But with fourteen turns and best-output selection, Fast₁ is only 68.5% versus 67.5%, and Fast₁.₂ is 22.2% versus 22.0%. These are almost the same as Dr. Kernel-14B. So I think CORAL's advantage may be more about doing better when the search budget is small, rather than finding substantially better results even after many search turns. The authors do report these numbers, but I think they should make this distinction clearer when discussing the main performance gains.
Questions for authors
Q1. Are the training budgets fair across the ablations?
Could the authors explain whether full CORAL and Ablations 3 and 5 use the same or roughly comparable training data, task sampling, number of policy rollouts, and extra compute for skill verification? Some settings differ in more than just removing a loss term. The training data and the way skills are used may also change. So I'd like to know how much of the improvement comes from joint training itself, and how much might be affected by extra data or compute.
Q2. Is CORAL mainly better at finding good kernels earlier?
Under fourteen-turn best-output evaluation, CORAL-14B and Dr. Kernel-14B perform quite similarly on Level 3. That makes me wonder whether CORAL's improvement in the three-turn setting mainly comes from finding useful optimizations within the first few turns. If the authors could show performance by turn, such as the speedup of the best kernel found up to each turn, it would help explain the method's advantage more clearly.
8 comments
A Kind Reminder for Reading the Response
Dear Reviewer xmf4,
Thank you for your comments.
As the rebuttal period is ending soon, we would greatly appreciate it if you could take a final look at our responses and see whether they address your concerns. Thank you for your time and consideration.
The Authors
Thank you for the response. However, my main concerns remain. It would be helpful to provide experimental results to further clarify these questions.
Thanks for your review. We have addressed the concerns as follows:
We agree that the gap between CORAL and Dr. Kernel will be smaller with more search turns. But in 19/24 cases, the CORAL is still better than Dr. Kernel.
There is some difference in the compute budget across the ablations. However, we just choose the best turn for each ablation as shown in Figure 3; more compute is useless.
CORAL's recursive evolution method is quite like some autoresearch methods. Based on their experience, there is 2 assertions:
The gap may not be that big, but it's still there, so such a method is still useful.