- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents AscendEvolve, an LLM-based system for Ascend C kernel generation. It argues that experience-based agents struggle to discover implementation mechanisms outside their existing knowledge. The method combines hierarchical, version-aware retrieval from platform sources with tree-based exploration and mechanism-level crossover, using execution feedback to guide subsequent retrieval.
Critical strengths
A well-motivated approach to an important practical problem. Combining version-aware platform evidence with execution feedback directly addresses unfamiliar APIs and implementation constraints. Grounding both exploration and repair makes the approach useful beyond initial code generation.
Critical weaknesses
- Comparison fairness and reliability are insufficiently established. The paper does not clearly report matched search budgets, total inference costs, baseline knowledge access, or variability across independent runs. Comparisons with closely related knowledge-augmented Ascend systems are also missing, limiting evidence of advancement over existing approaches.
- The distinctive methodological contribution is not sufficiently isolated. Removing the entire knowledge base establishes its usefulness, but does not identify the benefits of version-aware retrieval or bidirectional feedback over simpler retrieval augmentation.
Questions for authors
- Please clarigy what search budgets, model-call/token costs, and knowledge access each method receive.
- Under matched budgets and knowledge access, does AscendEvolve outperform a simpler retrieval-augmented baseline? Which gains specifically depend on version filtering and experience-guided retrieval?
- Prior work documents reward hacking in kernel generation, including bypassed computation and misleading timing measurements [1]. Were final kernels independently checked on hidden or freshly sampled inputs, including the case-specific numerical correction in Figure 8? Please clarify how timing integrity and attribution to the submitted NPU kernels were verified.
[1] Wei Liu, Jiawei Xu, Yingru Li, Longtao Zheng, Tianjian Li, Qian Liu, and Junxian He. Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations. ICML 2026.