- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces RepairChemist, a framework that transfers program-repair knowledge from a high-resource language (Java) to lower-resource languages without fine-tuning or translation. It distills bug-fix pairs into language-agnostic repair skills (defect patterns and repair actions) organized by statement types for structured retrieval, effectively guiding both procedural and repository-level repair agents. Across multiple languages (Kotlin, Ruby, Rust, Go) on xCodeEval and SWE-bench Multilingual, RepairChemist with Qwen3-30B achieves a 76.41% resolved rate on xCodeEval, notably outperforming direct repair (61.78%) and the strongest baseline LANTERN (71.85%).
Critical strengths
The paper's overall method is complete and its application path is clear, and it does not stop at single-function repair. The authors cover procedural workflows and repository-level agents, examine the overlap between source-language training problems and target evaluation problems, and provide ablations of the skill library, grouping, and sampling mechanisms.
Critical weaknesses
The significance of the research task is limited: currently, even the experimental results of the qwen3-30B model on the low-resource languages mentioned in the article all exceed 60%; does this mean that the generalization ability of current LLMs is already able to solve this problem fairly well?
Questions for authors
see weeknesses.
3 comments
Thank you for your explanation; I stand by my score.
Thank you for your support. We sincerely appreciate the time and effort you have devoted to helping improve the quality of our manuscript.
Thank you for the insightful review. We hope that our response below addresses your concern.
We agree that current LLMs have demonstrated certain capabilities in Low-Resource Program Repair. However, even with an average resolved rate exceeding 60%, Qwen3-30B still fails to repair nearly 40% of the tasks. RepairChemist improves its average resolved rate from 61.78% to 76.41% (+14.63pp), substantially enhancing its practical utility for low-resource program repair. We believe this research problem remains important for three reasons.
First, although existing LLMs have made progress on function-level repair tasks, they still face substantial challenges in more complex repository-level repair tasks[1, 2]. For example, Qwen3-30B achieves an average resolved rate of only 17.06% across the three target languages on SWE-bench Multilingual. Second, smaller models generally have more limited repair capabilities in low-resource languages. These models remain valuable in practical software development scenarios with limited computational resources, offline deployment requirements, or privacy constraints. Finally, as programming language ecosystems continue to evolve, emerging languages (e.g., Mojo, Cangjie, and MoonBit) and new language features are constantly introduced, making it difficult for models to fully acquire knowledge of these languages and features solely from their existing training data.
[1] Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving (NeurIPS 2025)
[2] On the Evaluation of Large Language Models in Multilingual Vulnerability Repair (TOSEM 2026)