- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Route2Learn, a single video MLLM that adaptively selects between temporal cropping and semantic frame retrieval for long-video question answering. Balanced supervised trajectories expose the model to both evidence-acquisition strategies; Counterfactual Routing Policy Optimization (CRPO) then compares factual and forced alternative-route rollouts, assigns a routing advantage to tool-turn tokens, and reserves the normal outcome advantage for answer tokens. Experiments on LVBench, VideoMME, MLVU, and LongVideoBench report an average accuracy of 63.4%, compared with 53.0% for Qwen3-VL-8B and 58.7% for the strongest listed open baseline. Ablations compare adaptive, fixed, and random routing and examine SFT, GRPO, CRPO, and shared versus decoupled advantages.
Critical strengths
The central formulation is consequential and well motivated: assigning both complementary evidence-acquisition tools to the same trainable MLLM removes the usual separation between retrieval behavior and policy optimization. This is a meaningful departure from both crop-only native agents and agent systems with frozen external retrievers.
The empirical evidence, especially Table 2, provides a substantive initial case for the method. Adaptive routing improves the four-benchmark average from 60.7% for the best fixed strategy and 59.5% for random routing to 63.4%, while CRPO with eight factual rollouts exceeds GRPO with sixteen. These comparisons indicate that the gains are not plausibly explained only by adding a reasoning or tool-use stage.
Critical weaknesses
The paper does not yet cleanly isolate the routing effect that CRPO claims to optimize. A factual trajectory may use multiple tools, but the “alternative route” is described only by forcing the alternative first tool and regenerating the rest. The resulting accuracy difference can therefore reflect later differences in tool sequences, prompts, and sampling rather than a controlled intervention on one routing decision. Moreover, the routing advantage is applied to every non-final thought token, so it remains unclear which tokens actually encode the intended choice. The paper should define what constitutes a route, enforce pure-route or explicitly paired rollouts, and report route-choice and factual-versus-counterfactual success statistics.
The headline comparisons also need stronger controls. Table 1 does not make clear whether all open baselines were rerun with the same frame budget, number of tool calls, decoding, answer parser, and evaluation prompt. Route2Learn may use up to three tool-calling turns and three crop calls per turn, so unmatched visual evidence budgets could explain part of the large gap. In addition, the main results appear to come from a single training run, and the paper does not audit overlap between the four evaluation benchmarks and the auxiliary Video-R1, LongVideo-Reason, LongVT, or CG-Bench training sources. These issues are fixable, but until addressed they materially limit confidence in the reported magnitude and causal interpretation of the gains.
Questions for authors
-
Precisely how is a “route” defined when the factual rollout changes tools across turns? Does the counterfactual pair isolate one tool decision while holding the preceding trajectory fixed, and exactly which tokens receive the routing advantage?
-
Were all baselines in Table 1 rerun under the same visual-frame/token budget, maximum tool-call budget, prompt, decoding procedure, and answer-extraction protocol? Please report average frames, tool calls, and visual tokens for Route2Learn and the strongest baselines.
-
Can you report quantitative routing diagnostics, such as tool-selection distributions by query type, factual and alternative-route success rates, and an oracle-route upper bound? These results would directly test whether the model learned the claimed query-adaptive behavior rather than relying only on case studies.