- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ReWAM addresses the mismatch between candidate-aware training rewards and input-only reasoning in a decoupled reasoner--embedder system. Retrieval-Aware Self-Distillation (RASD) uses input evidence, positive--negative distinctions and claim verification to reweight GRPO advantages at the token level. Retrieval-Adaptive Inference (RAI) predicts remaining retrieval utility and combines early stopping with speculative decoding. The strongest configurations reach 67.4/69.0 on MMEB-V2 and 53.3 on MRMR.
Critical strengths
-
The motivation is clear, and some observations are insightful. A successful retrieval trajectory can still contain unsupported or irrelevant claims, so using grounded candidate comparisons to refine its training signal is a sensible idea.
-
The evaluation is broad and comprehensive, covering 78 MMEB-V2 datasets and 11 MRMR subtasks across several embedding backbones.
Critical weaknesses
-
The highest accuracy and the main acceleration results come from different configurations, leaving the final system's joint accuracy and efficiency unverified. Appendix B.4 explicitly states that RAI is not enabled in the main retrieval tables. The detailed acceleration experiments use only the Qwen2-VL-2B embedder and do not cover all configurations achieving the main results or the MRMR benchmark. The authors should clarify this mismatch. The overall pipeline is also quite complex, and I would like to better understand its efficiency and whether its performance gains are attributable to external modules or additional parameters.
-
The authors identify two issues in current reasoning-based embedding methods: the mismatch between candidate-aware supervision and input-only reasoning, and the potential redundancy in reasoning. These observations are insightful, but existing methods, such as MMEmb-R1[1], TRACE[2], and Think When Needed[3], also address similar issues. In particular, the two problems targeted by MMEmb-R1 are largely the same as those considered in this paper. The authors should compare against these methods, or at least discuss their similarities and differences, to better establish the paper's contribution.
[1] Yuchi Wang et al. MMEmb-R1: Reasoning-Enhanced Multimodal Embedding with Pair-Aware Selection and Adaptive Control. 2026.
[2] Xiangzhao Hao et al. TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrieval. 2026.
[3] Longxiang Zhang et al. Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture. 2026.
Questions for authors
The experiments do not directly demonstrate that RASD makes reasoning more grounded or reduces unsupported content. The current evidence mainly consists of overall retrieval scores, without a fine-grained analysis of whether RASD actually reduces unsupported content.
2 comments
Response to Reviewer Bjey (2/2): W2 and Q1
W2. Comparison with related adaptive reasoning methods
The authors identify two issues in current reasoning-based embedding methods: the mismatch between candidate-aware supervision and input-only reasoning, and the potential redundancy in reasoning. These observations are insightful, but existing methods, such as MMEmb-R1[1], TRACE[2], and Think When Needed[3], also address similar issues. In particular, the two problems targeted by MMEmb-R1 are largely the same as those considered in this paper. The authors should compare against these methods, or at least discuss their similarities and differences, to better establish the paper's contribution.
[1] Yuchi Wang et al. MMEmb-R1: Reasoning-Enhanced Multimodal Embedding with Pair-Aware Selection and Adaptive Control. 2026.
[2] Xiangzhao Hao et al. TRACE: Task-Adaptive Reasoning and Representation Learning for Universal Multimodal Retrieval. 2026.
[3] Longxiang Zhang et al. Think When Needed: Adaptive Reasoning-Driven Multimodal Embeddings with a Dual-LoRA Architecture. 2026.
2、Response.
We thank the reviewer for recognizing the motivation behind our work and for pointing us to these closely related studies. We agree that they share the broad goal of making reasoning useful and efficient for multimodal retrieval.
MMEmb-R1 uses counterfactual pair-aware selection to identify beneficial reasoning paths and learns whether to invoke reasoning for an input. TRACE integrates structured CoT generation with embedding learning and exhibits adaptive behavior that bypasses reasoning for simpler queries. Think When Needed uses a shared-backbone dual-LoRA architecture and a routing gate to decide whether to generate CoT. These methods primarily address whether reasoning should be used, which trajectory to select, or how reasoning should be integrated with embedding learning.
However, these methods depend on sampled candidates when their adaptive decisions are trained on within-batch retrieval gains. This creates a risk of batch-specific shortcuts and weak generalization. We mitigate this risk through RASD, which uses input-grounded contrastive evidence to provide token-level supervision. It conditions an on-policy self-teacher on input-supported evidence and positive–negative decision boundaries to refine coarse trajectory-level retrieval feedback. This guides training toward supported, discriminative reasoning instead of uniformly reinforcing an entire successful CoT. RAI further adapts reasoning after generation begins, predicting remaining retrieval utility from each prefix to stop unnecessary continuation. It also accelerates token generation with speculative decoding. These designs extend adaptive reasoning beyond input-level routing and trajectory selection.
We have added these references to §2 and expanded the discussion of their shared motivations, limitations, and technical differences in Appendix E.
Questions
Q1. Grounding and unsupported content
The experiments do not directly demonstrate that RASD makes reasoning more grounded or reduces unsupported content. The current evidence mainly consists of overall retrieval scores, without a fine-grained analysis of whether RASD actually reduces unsupported content.
3、Response.
We thank the reviewer for raising this concern. We have added claim-level CoT comparisons in Appendix C.3 (Figs. 15–17) to make the grounding differences directly inspectable. Each comparison uses the same images and user prompt and shows complete greedy CoTs without RAI truncation.
| Case | GRPO reasoning | RASD reasoning |
|---|---|---|
| Fig. 15, MRMR Math | Introduces a square absent from the input and uses its supposed side length as the cone's base radius. | Uses the sector's arc as the cone's base circumference and its radius as the slant height. |
| Fig. 16, MRMR Physics | Treats 100% transformer efficiency as equal primary and secondary voltages, despite the given turns ratio. | Applies the 1:20 turns ratio and power conservation specified by the input. |
| Fig. 17, MRMR Engineering | Interprets a simply supported beam as fixed at both ends and builds further calculations on this incorrect premise. | Respects the pin–roller supports and triangular load shown in the input. |
These examples show RASD-trained reasoning following input-supported constraints and avoiding the unsupported premises seen in the GRPO traces. The complete RASD CoTs are also shorter in these three cases, with 143 versus 431, 107 versus 388, and 135 versus 454 words, respectively. The visualizations therefore provide claim-level qualitative evidence of better grounding and less redundant reasoning, complementing the retrieval ablations in Tables 2 and 4.
Response to Reviewer Bjey (1/2): W1
We thank you for your feedback on the joint evaluation, related methods, and grounding evidence. Our responses include paired accuracy–throughput results, an expanded comparison with prior work, and direct CoT visualizations. We hope these additions resolve your concerns and would sincerely appreciate a more favorable score.
Weaknesses
W1. Joint accuracy-efficiency evaluation and pipeline cost
1、Response.
We thank the reviewer for raising this concern. Our results in Tables 1–2 evaluate retrieval quality using full CoTs without RAI, whereas Table 6 isolates RAI's inference-time effects with the Qwen2-VL-2B embedder (Appendix B.4). To directly assess accuracy and speed under the same model configurations, we have added comparisons with RAI disabled and enabled in Tables 12–13. These additional experiments cover three MMEB-V2 embedders and our strongest MRMR model. The draft length is fixed at K=7. Each pair below shows without RAI → with RAI, and speedups are computed from the reported throughput values.
MMEB-V2: paired retrieval accuracy and throughput (Appendix C.1, Table 12).
MRMR: Qwen3-VL-4B (Appendix C.1, Table 13).
Across the three MMEB-V2 embedders, RAI provides 2.6–4.3× throughput with 0.2–0.4-point score decreases. RAI is trained on general-purpose MMEB data. MRMR instead focuses on reasoning-intensive retrieval evaluation, introducing a shift in the query distribution. Under this shift, RAI still achieves 1.72× throughput with only a 0.9-point score decrease. The accelerated score of 52.4 still exceeds RIME’s 50.2 (Table 2), retaining state-of-the-art retrieval performance. This demonstrates a favorable accuracy–speed trade-off, supporting its generalization to reasoning-intensive retrieval.
We clarify that RASD improves the existing reasoner through token-level training supervision, without enlarging the reasoner or embedder backbone (Tables 3–5). We evaluate inference acceleration over the complete encoding pipeline, including CoT generation, embedding extraction, and the overhead of RAI's utility head and draft model (Appendix B.4). The observed speedup therefore reflects the overall inference efficiency of the ReWAM paradigm.