- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3(+1)
- Soundness
- 3(+1)
Read review
Paper summary
This paper studies query intent drift in reasoning-based RAG, where later sub-queries become increasingly influenced by previous retrieval trajectories, causing early search errors to accumulate over multiple reasoning steps. To characterize this behavior, the authors introduce search momentum, which captures the accumulated semantic direction of sub-query changes, and show that later queries tend to follow this momentum rather than naturally correcting earlier deviations. Based on this observation, they propose MAPS, which combines reasoning disentanglement—keeping only retrieved knowledge and a refined reasoning state instead of the full history of reasoning traces and sub-queries—with parallel reasoning, where multiple complementary retrieval directions are proposed and searched in parallel at each iteration. Experiments on NQ, PopQA, 2WikiQA, HotpotQA, MuSiQue, and GPQA using Qwen3-32B and Qwen3.6-35B-A3B show that MAPS consistently outperforms baselines such as Vanilla RAG, Self-RAG, IRCoT, Search-o1, S3, and ParallelSearch. Ablation and analysis further suggest that both parallel reasoning and disentanglement help reduce search drift and keep retrieval better aligned with the original question and supporting evidence.
Critical strengths
- The paper propose search momentum to measure the deviation of multi-hop qa searches and use it to discover problems in the trajectory.
- The paper propose reasoning disentanglement and parallel reasoning to alleviate the query drift and the experiments are good.
Critical weaknesses
- MAPS uses parallel queries while equal-budget comparison and efficiency analysis is needed to see whether the improvement comes from larger queries and computational budget. Only comparison with ParallelSearch is not enought while budget should be reported. Also another easy baseline pass@k should be reported.
- There seems no relation between search momentum and MAPS. Since MAPS does not explicitly estimate or regulate the momentum variable during inference, it is unclear whether search momentum is an essential mechanism underlying the method or mainly an explanatory diagnostic.
Questions for authors
The proposed notion of search momentum is interesting but its empirical validation is somewhat post-hoc. The momentum coefficients are explicitly fitted to maximize alignment with future query deviation, making the observed correlation partly induced by the construction itself. Can we use the momentum to guide the future and then make the momentum more relative to the MAPS method?
2 comments
A Gentle Reminder
Dear Reviewer,
Thank you again for your time and thoughtful feedback. As the discussion period is approaching its conclusion, we would like to briefly follow up on our rebuttal. We have carefully addressed each of your comments and sincerely hope that our responses have clarified the concerns you raised.
If you have any remaining questions or concerns, we would be happy to provide further clarification during the remaining discussion period.
Best regards,
The Authors
Reply to RUnq 2
Reply to Weakness 1: We thank the reviewer for this comment. We address retrieval-budget matching in first point of our General Response. Specifically, we set the number of passages retrieved per iteration by Naive-RAG and Search-o1 to match the average number retrieved per iteration by MAPS. Under the matched passage retrieval budget, MAPS still achieves higher average performance, indicating that its advantage does not simply stem from retrieving more passages.
Furthermore, we compute pass@3 for both Search-o1 and MAPS. For each question, we independently sample three answers from each method under the same experimental settings. An instance is considered successful if at least one of the three answers is correct. As shown in the table below, MAPS consistently outperforms Search-o1.
Reply to Weakness 2: We thank the reviewer for this comment. In our paper, search momentum not only provides key motivation for the design of MAPS, but also helps assess whether the model becomes trapped in a particular local search drift during reasoning. Although deviations in the retrieval direction can be valuable during reasoning, as the process progresses, the accumulated context may cause the model to increasingly rely on the existing retrieval trajectory, thereby reducing its exploration of potentially useful directions. The search momentum experiments in Section 2 of our paper reveal this phenomenon and motivate the key mechanisms of MAPS, which calibrate the retrieval trajectory in the early stages of reasoning and help prevent subsequent reasoning from becoming trapped in a locally biased retrieval direction.
Reply to Question 1: We thank the reviewer for raising this question. Search momentum is computed as a weighted sum of historical changes in query intent, characterizing the accumulated retrieval tendency arising from historical sub-query movements along the reasoning trajectory. The coefficient β is fitted only on the training trajectories and then held fixed. The correlation between search momentum and subsequent sub-query deviations is evaluated on independent test trajectories. Therefore, fitting and validation are conducted on different trajectories, and the observed correlation is independently verified on the test trajectories rather than induced by the construction of the metric itself.
The connection between search momentum and MAPS is directly reflected in the method design. During reasoning, local deviations in the early retrieval stages reflect the model’s exploration of diverse and potentially useful directions. However, as reasoning progresses, the growing context causes the model to rely increasingly on the existing trajectory, gradually reducing its exploration of other valuable directions. We observe this phenomenon in the search-momentum experiments in Section 2 of our paper, which directly motivates the key mechanisms of MAPS. Thus, search momentum not only provides motivation for MAPS, but also helps assess whether the reasoning process has become trapped in a particular local retrieval direction. Furthermore, we believe that search momentum can be further used to assess retrieval quality and determine appropriate stopping points, providing a promising direction for future research.