- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SweRank+ extends SweRank to multilingual function-level issue localization. It introduces SweLocMulti, with 155,663 training instances across ten programming languages, and trains retrievers and rerankers using the existing SweRank objectives. It also adds a GPT-5-driven agent that reformulates queries using retrieved code and aggregates candidates across turns. Evaluation on five benchmarks shows improvements from multilingual training and further gains from the agent.
Critical strengths
-
Extending to ten languages addresses a practical gap in Python-heavy localization research. The dataset and resulting models are the paper’s strongest contribution.
-
Broad empirical validation on multilingual and Python benchmarks.
Critical weaknesses
-
Limited methodological novelty. The main contributions are the multilingual dataset and trained models, while the data pipeline and training objectives largely follow SweRank. The SweRankAgent also combines familiar components, and its distinction from prior iterative repository retrieval [1] needs clearer discussion.
-
Missing details and deeper experiments. The agent’s search budget and memory management are underspecified. There are also no component ablations, parameter sensitivity experiments, or comparisons across agent LLMs to explain where the gains come from.
[1] Fengji Zhang et al. RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generation. EMNLP 2023.
Questions for authors
-
What were the maximum and average search rounds, token usage, and inference cost? Were these budgets matched to the six-query Reformulate baseline?
-
What is new in the SweRankAgent beyond adapting existing iterative retrieval pipelines to localization? Could you support this with component ablations, sensitivity experiments, and comparisons using different agent LLMs?