- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes AdaMM-RAG, an adaptive multi-source multimodal RAG framework that uses a planner agent to dynamically select retrieval sources based on each query. The framework further incorporates a cross alignment agent to unify heterogeneous evidence, a Decision Agent for answer refinement and verification, and a quality gate for fallback retrieval when evidence is insufficient. Experiments on two benchmarks show improvements in accuracy over existing multi-agent RAG baselines, while reducing retrieval overhead through selective source invocation.
Critical strengths
The proposed method achieves strong results on two benchmarks while selectively invoking retrieval sources, demonstrating a favorable trade-off between accuracy and retrieval efficiency. It reduces unnecessary source invocations, achieving a 55.5% reduction in normalized retrieval cost and lower end-to-end latency.
Critical weaknesses
Thanks for the authors' submission. The paper is well written and illustrates the method clearly, however, I still have several concerns about this paper:
- The main concern is about novelty. While the proposed framework demonstrates practical benefits, its core components largely build upon existing techniques. The planner performs prompt-based source selection, the cross alignment agent uses existing vision-language models and text-based evidence normalization, and the Decision Agent relies on LLM-based reasoning and verification. Although their integration improves efficiency and performance, the paper does not clearly establish what new methodological insights emerge from this combination. Therefore, the proposed method is more likely to be an engineering trick.
- Section 3.6 restricts fallback retrieval to single-source queries with insufficient evidence. However, evidence insufficiency can also occur when multiple sources are selected, particularly if the Planner omits a necessary source. The assumption that multi-source comparison provides sufficient validation is not clearly justified.
- The reported 55.5% cost reduction is based on normalized retrieval operation counts, which do not account for the additional LLM inference overhead introduced by the multi-agent framework. Although end-to-end latency is evaluated, the authors should further report token consumption and inference costs to provide a more comprehensive assessment of the overall efficiency gains.
Questions for authors
- The improvement over HM-RAG is particularly substantial on CrisisMMD, while the component ablation is only conducted on ScienceQA. Could the authors clarify which components contribute most to these improvements and whether the compared methods use consistent backbone models and inference budgets?
- Figure 2 shows that the Planner predominantly selects Entity and Relation retrievers, while Graph and Web retrieval are rarely invoked. How do the authors evaluate whether the selected sources are appropriate and sufficient for each query, beyond retrieval frequency and cost reduction?
- How does the proposed Planner compare with a straightforward LLM-based tool-selection strategy? Could a simpler router achieve comparable accuracy and efficiency improvements?
- Could the authors further clarify the methodological novelty of the proposed method beyond integrating existing RAG components? The planner appears to perform source selection through a prompt-based LLM call, while the alignment, decision, and fallback mechanisms primarily combine existing techniques for evidence normalization, LLM-based reasoning, and conditional retrieval. What additional benefits does the proposed multi-agent architecture provide over a simpler RAG workflow with LLM-based source routing and evidence aggregation?