- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ThinkBridge, which keeps a large reasoning model (Qwen3) frozen and trains a lightweight external reasoner (about 5% of the backbone’s parameters) to map the question’s hidden states into a short sequence of latent states that guide the model to answer without generating an explicit thinking trace. The reasoner is trained on the model’s own correct responses from both thinking and non-thinking modes, using cross-entropy supervision, on-policy distillation that aligns latent-conditioned predictions with full-CoT-conditioned ones, and a contrastive objective that encourages question-specific latent states. On five math benchmarks, ThinkBridge achieves the highest mean accuracy among the evaluated latent reasoning methods at 0.6B and 4B, with a time to first response token of about 45–56 ms, and it also leads these baselines on a three-turn math dialogue task without dialogue-specific training.
Critical strengths
- Lightweight and cheap at inference. The reasoner adds only about 5% of the backbone’s parameters (29.4M for 0.6B, 183.7M for 4B, Table A1), and TTFT is 45–56 ms, far below CoT-SFT (1.4–2.0 s) and all latent baselines (218–606 ms), and stable across benchmarks (Table G1).
- Generalizes to multi-turn dialogue without dialogue training. Trained only on single-turn questions, the same reasoner leads all latent baselines at every turn on MathChat; at 4B, turn-two and turn-three accuracies (69.34% and 61.77%) stay close to non-thinking mode (70.80% and 62.77%), while the latent baselines collapse to 7–21%.
Critical weaknesses
- No gain over the untrained non-thinking mode, which is the baseline that actually matters. At 0.6B, ThinkBridge averages 63.53% versus 63.97% for non-thinking mode, while being twice as slow (45.50 vs. 20.74 ms TTFT), and it is 6.3 points worse on SVAMP. At 4B, the gain is only 1.09 points from a single seed. On MATH-500, the two are essentially identical (50.40% vs. 50.40%; 82.40% vs. 82.00%). The method adds a trained module and extra latency for no clear benefit.
- No evidence that the latent states carry reasoning. There is no test replacing with zeros, random vectors, or another question’s latent states, and no comparison with a question-independent learned prefix (standard prompt tuning). Figure F1 shows ThinkBridge and non-thinking mode agree on most questions (only 5.9% vs. 4.2% uniquely solved at 4B). The simplest explanation is that acts as a soft prompt nudging the response style, not as latent reasoning.
- TTFT hides the real latency. TTFT stops at the first response token, so reasoning written inside the response is never counted, while CoT-SFT’s reasoning is. This makes ThinkBridge look 30× faster than CoT-SFT even if both produce similar amounts of reasoning text. Total generation time or total output tokens is needed.
Questions for authors
- At 0.6B, ThinkBridge averages 63.53% in Table 1, below the untrained non-thinking mode (63.97%), while also having a higher TTFT (45.50 vs. 20.74 ms); on SVAMP the gap is 6.3 points (76.33% vs. 82.67%). At 4B, the gain over non-thinking mode is 1.09 points from a single seed. What practical advantage does ThinkBridge offer over simply using the backbone’s non-thinking mode? Could you report results over multiple seeds to show whether the 4B gain is statistically meaningful?
- On MATH-500, ThinkBridge matches non-thinking mode almost exactly (50.40% vs. 50.40% at 0.6B; 82.40% vs. 82.00% at 4B), even though the reasoner is trained only on GSM8K-Aug-NL. How do you rule out the explanation that the reasoner barely changes the model’s behavior out of domain? Could you report how often ThinkBridge’s MATH-500 responses differ from non-thinking responses, in final answers or in the text itself?
- Figure F1 shows that at 4B, ThinkBridge and non-thinking mode jointly solve 72.8% of questions, with only 5.9% and 4.2% solved uniquely by each. Given this high agreement, what evidence shows that the latent states provide reasoning beyond what non-thinking mode already does?
- Author report that ThinkBridge solves 74.3% and 93.3% of the questions solved by thinking mode at 0.6B and 4B. What are the corresponding coverage rates for non-thinking mode itself? From Figure F1, non-thinking mode’s pooled accuracy at 4B (about 77.0%) is close to thinking mode’s (about 79.7%), so its coverage may be similarly high. Without this reference, how should the 93.3% figure be interpreted?