- Rating
- 3
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether the reasoning capability of black-box LLMs can be extracted without seeing their internal chain-of-thought traces. The authors propose Trace Inversion. It first trains an inversion model on surrogate reasoning traces. Then it uses this model to synthesize detailed reasoning traces from the victim model's final answers and optional reasoning summaries. These synthesized traces are used to fine-tune student models. Experiments on DeepSeek-R1 and GPT-5.4 mini show that synthesized traces can give better supervision than directly using answers, summaries, or weak surrogate traces, especially on math and science reasoning tasks.
Critical strengths
-
The problem studied in this paper is interesting and has practical meaning. The paper shows that hiding internal reasoning traces is not enough to prevent reasoning capability extraction through black-box access.
-
The pipeline is simple and easy to understand. I also appreciate that the authors clearly distinguish two things: reconstructing the victim's real reasoning traces, and generating useful reasoning supervision for distillation. This distinction is important.
-
The experiments are relatively comprehensive. They cover open-weight and commercial black-box victims, different surrogate strengths, multiple student models, and both summary and no-summary settings. The gain over surrogate-trace distillation is convincing when the surrogate is weak, although it is less stable when the surrogate is already strong.
Critical weaknesses
-
The primary issue with this paper lies in its experimental design. The paper’s central claim is that computation is more valuable than memory; however, the experimental design compares only
direct/cmd,think/cmd,think/body, andthink/full, omitting thedirect/fullcondition. This is surprising, as the current experiments only demonstrate that when a model engages in "re-thinking," the original Chain-of-Thought (CoT) may offer little additional value. Conversely, when the model does not re-think, the original CoT could The cross-model generalization of the method is not fully understood. The inversion model is trained to reconstruct reasoning from the surrogate's own answers, but at inference time it must generate reasoning for potentially different answers provided by the victim. It is unclear how well this works when the surrogate fails to solve a problem that the victim answers correctly. The paper provides overall cross-model evidence, but it does not analyze the boundary conditions of this generalization. An analysis separating examples where surrogate and victim answers agree or disagree would be useful. -
The paper does not fully establish the necessity of training a dedicated inversion model. The current zero-shot baseline uses an instruction-tuned Qwen model, but a stronger comparison would be to directly prompt an existing reasoning-capable model to generate detailed traces conditioned on the victim's answers, without additional inversion training. Since the trained inverter also produces substantially longer traces, controlling for reasoning length and student training-token budget would help determine whether the improvements come from inversion training itself or simply from richer reasoning supervision.
Questions for authors
I would be very grateful if the authors could address the issues I raised in the "Weaknesses" section.
2 comments
Thank you for the clarifications and additional experiments. I maintain my score.
We thank the reviewer for the positive assessment and constructive suggestions.
Clarification. We respectfully note that the opening discussion of “computation versus memory” and the direct/cmd, think/cmd, and think/body conditions appears to refer to another paper, as these are not discussed in our work.
Cross-model generalization. Our inverter learns from surrogate reasoning traces but conditions on the victim's observable answers and optional summaries, without accessing its hidden reasoning traces. On JEEBench, GPT-5.4 mini achieves 85.1%, versus only 32.6% for R1-Weak, whose traces train our inverter. Despite this substantial capability gap, victim-conditioned inversion improves Qwen student accuracy from 19.7% (Surrogate-Trace) to 31.6%. This demonstrates cross-model capability transfer, although per-example surrogate–victim disagreement remains an interesting direction for further analysis.
Stronger zero-shot baseline. We additionally evaluated Qwen3.5-35B-A3B, a substantially stronger reasoning model, using the same observable victim information. With 10k training examples, its student achieves 54.2% on MATH500 and 22.8% on JEEBench, compared with 76.0% and 43.7% for our original inverter-based student. Thus, even a stronger pretrained reasoning model falls short of the downstream student performance achieved with our synthesized traces.
Reasoning length and supervision. The original zero-shot baseline generates approximately 979 tokens per trace, and Qwen3.5-35B generates 2,034, compared with 4,971 and 5,767 tokens from our R1-Weak- and R1-trained inverters, respectively. This difference is not merely an experimental confound: synthesizing richer reasoning supervision from limited black-box outputs is a central capability of our attack. While matching supervision-token budgets would help isolate the contribution of inversion training, simply truncating synthesized traces would discard potentially useful reasoning steps. To further assess the quality of this additional supervision, we conducted an LLM-as-Judge evaluation of potential distillation utility, which preferred our R1-trained inverted traces over zero-shot (56–14).