- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a training-free decoding method that combines a domain-specialized model with a general reasoning model using token-level routing based on JS divergence. The method is simple and achieves strong improvements across several scientific reasoning benchmarks. However, the evaluation is limited to scientific specialist-generalist settings, the theoretical guarantees rely on strong assumptions about when each model should be preferred, and the current baselines do not fully demonstrate that the gains come specifically from the proposed JS-divergence routing mechanism. Overall, the paper presents a practical and effective capability-fusion approach, but its central claims would benefit from stronger theoretical and empirical support.
Critical strengths
The paper presents a simple and practical approach for combining specialist and general-purpose language models at inference time without requiring additional training. The proposed divergence-based routing mechanism is model-agnostic and can be applied to different specialist-generalist pairs with minimal changes to the underlying models. Empirically, the method demonstrates strong and consistent improvements across multiple scientific reasoning benchmarks, often outperforming both constituent models.
Critical weaknesses
-
The theoretical results rely on assumptions that are not directly validated in the paper. In particular, the guarantees require that low-divergence states favor the specialist model and high-divergence states favor the generalist model. Since the effectiveness of the method depends on these assumptions, the theory provides limited evidence that JS divergence is a reliable routing signal beyond the studied settings.
-
The empirical evaluation is restricted to scientific specialist-generalist model pairs. It is therefore unclear whether divergence-based routing would remain effective for other forms of specialization, such as coding, mathematics, or legal reasoning.
-
The paper does not fully isolate the contribution of JS-divergence routing. While comparisons are provided against speculative decoding, self-resampling, and CITER, stronger training-free routing or model-selection baselines are absent. As a result, it is difficult to determine whether the gains arise specifically from the proposed divergence criterion or more generally from combining complementary models.
-
The routing policy depends on a calibrated divergence threshold. The paper proposes a threshold-selection procedure, but provides limited analysis of how sensitive the method is to threshold choice across different benchmarks and model pairs.
-
The proposed approach requires inference with both models throughout decoding. This increases computational cost and latency relative to single-model generation, and the paper provides only limited analysis of the resulting cost-performance tradeoff.
-
The paper mainly analyzes successful capability fusion settings. A more detailed characterization of cases where routing fails, or where one model consistently dominates the other, would help clarify the limitations of the proposed approach.
-
There are a few minor presentation issues. For example, a LaTeX expression appears to be incorrectly rendered around line 819, and there is a quotation-mark formatting issue around line 928. A careful proofreading pass would improve the overall presentation quality
Questions for authors
Chek my comments in Weaknesses