- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce an analysis for multi-hop rag problem. They do a detailed analysis of this problem in two parts: Retrieval and Reasoning. Then they do a small SFT Experiment to improve the ability for solving multi-hop rag problem.
Critical strengths
They divided the multi-hop RAG problem into two tiers for analysis. The experiments in this part were very solid, comparing mainstream baselines.
Critical weaknesses
The first half of the paper points out one of the main bottlenecks for small models is reading distractor evidence. However, the second half mainly tests the difference between searching and reading using search trajectory distillation, without further showing how to use this diagnosis to fix the reading bottleneck. Therefore, I feel the SFT part is mostly just validating their analysis, and its contribution as a method for performance improvement is still limited.
Questions for authors
The distillation experiments only evaluated the Opus 4.6 to Qwen3-8B-Base teacher-student pair. I want to see a broader range of student models across different sizes and model families.