- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
TRACE combines selective query-side reasoning with dense multimodal retrieval. The first generated token chooses between immediate embedding and a retrieval-oriented reasoning sequence, and both routes use the hidden state predicting the same embedding marker. Candidates are encoded directly, preserving offline indexing. The authors construct mixed direct/reasoning supervision and jointly optimize generation and contrastive losses. TRACE reaches 58.8 on M-BEIR versus 56.7 for a backbone-matched LamRA-Ret reproduction, with additional transfer experiments and controlled studies on MSCOCO and CIRR.
Critical strengths
-
The writing is generally clear, and the design is clean and practical. The first-token decision avoids an additional routing network and is simple yet effective.
-
The main retrieval gains are consistent: TRACE improves over the backbone-matched LamRA-Ret reproduction in all 16 settings in Table 1. The experiments are also comprehensive, with transfer evaluations covering composition, dialogue, interleaved context, and negative constraints.
Critical weaknesses
-
The backbone-matched LamRA-Ret comparison in the main table demonstrates the effectiveness of the overall method. However, it does not sufficiently establish the additional benefits of the proposed interface over existing reasoning-based or gated retrievers. I would therefore like to see comparisons with more closely related reasoning-based or adaptive retrieval methods, such as MMEmb-R1 and Think When Needed, using the same backbone, supervision data, and training budget. Such comparisons would help clarify the value of first-token routing and the shared representation interface, which together constitute the paper's core contribution.
-
The supervision for both when to reason and how to reason comes entirely from the teacher model, GPT-4.1. This raises the concern that the method may largely amount to distilling the teacher model's behavior. It also substantially limits the methodological novelty. Moreover, the current experiments do not establish that the routing mechanism selects queries that actually need reasoning. The paper reports that approximately 96% of MSCOCO queries are encoded directly, while approximately 62% of CIRR queries follow the reasoning path. This shows that the model adopts different strategies across tasks, but does not directly demonstrate that the queries selected for reasoning are those that benefit most from it. I suggest evaluating both paths on the same queries and comparing the learned routing policy with random routing and fixed task-based routing under the same reasoning budget. This is my main concern regarding the paper's central claim of adaptivity.
For me, this is borderline, with a slight negative lean. The authors address a valuable problem, and the method appears to offer some benefits. However, several key claims lack experimental support, and the methodological novelty is limited. Overall, I find the academic contribution somewhat insufficient.
Questions for authors
See wkness