- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Dr.CoT, an inference-time framework that uses prompt-conditioned sparse feature coverage to improve the accuracy-efficiency trade-off of large reasoning models. It uses a sparse autoencoder (SAE) to map the input prompt and generated chain-of-thought (CoT) into a shared sparse feature space. The framework consists of two components:
- Coverage-Guided Sufficiency Diagnosis. Measures prompt feature coverage and its recent gains to determine when reasoning is sufficient. Reasoning stops when coverage is sufficiently high and gains remain low across consecutive windows.
- Residual Feature Steering. Uses uncovered prompt features to construct dynamic steering directions, guiding the model toward information that has not yet been addressed.
Experiments on three Qwen3.5 models (2B, 9B, and 27B) across four math and science reasoning benchmarks show that Dr.CoT reduces token usage by 17.01% while improving accuracy by 2.16 percentage points over standard CoT.
Critical strengths
- The paper proposes a novel unified framework that uses sparse feature representations for both reasoning termination and trajectory steering. Combining reasoning state modeling, sufficiency diagnosis, and dynamic steering is an interesting and meaningful contribution.
- Dr.CoT achieves a competitive accuracy-efficiency trade-off across different model scales and reasoning benchmarks. The improvements are particularly notable on smaller models.
- The paper provides useful ablation studies and computational cost analysis. Table 2 shows that coverage-guided stopping mainly reduces token usage, while residual feature steering improves accuracy. Table 4 compares different steering directions and provides evidence for the effectiveness of uncovered feature steering. Table 6 reports FLOPs, throughput, and GPU memory usage, which helps assess the practical cost of the method.
Critical weaknesses
- Although Dr.CoT improves overall accuracy and reduces token usage across all three model scales, Table 1 shows accuracy drops on some individual benchmarks compared with standard CoT. It would be helpful if the authors could further analyze the reasons for these drops.
- In Table 3, the authors replace the current problem's prompt features with those from another problem as a baseline. However, using unrelated prompt features to assess reasoning sufficiency is likely to hurt performance. Therefore, this comparison is not particularly convincing. More meaningful baselines would help better validate the effectiveness of coverage-guided sufficiency diagnosis.
Questions for authors
N/A
3 comments
Thanks for the authors' response, and I will maintain my positive scores.
Thank you very much for taking the time to review our rebuttal. We sincerely appreciate your thoughtful feedback and continued positive assessment of our work.
Response to Reviewer YmrT
We appreciate your careful assessment and recognition of our prompt-conditioned feature modeling for sufficiency diagnosis and trajectory steering. Our responses to your comments W1–W2 are as follows:
W1: The paper's Table 1 shows accuracy drops on some individual benchmarks. What causes these drops?
We inspected cases where Vanilla answered correctly but Dr.CoT did not and identified overthinking as one remaining failure mode.
With Qwen3.5-9B on HMMT problem 9, Dr.CoT reaches the correct result, 50−2101−150, at about 22k tokens. It continues for another 10k tokens, while the coverage ratio rises only from 83.9% to 84.4%. Subsequent reconsideration introduces a boundary error, and the final answer becomes 50, omitting the correction term retained in Vanilla's final answer.
With Qwen3.5-2B on GPQA problem 120, Dr.CoT initially derives dpdN∝p−4 and selects A. It then reinterprets the question, replaces three-dimensional spherical-shell counting with two-dimensional ring counting, and switches to B (p−3). Vanilla also reconsiders the question but ultimately outputs A, illustrating that continued reasoning does not necessarily overturn a correct answer.
Although Dr.CoT reduces overthinking overall, these cases show room for more precise coverage-guided sufficiency diagnosis. Finer-grained stopping signals could better distinguish useful verification from redundant reconsideration and preserve correct intermediate results.
W2: Beyond the shuffled-prompt comparison, can more meaningful baselines further validate coverage-guided sufficiency diagnosis?
We compared fixed-budget Vanilla with Dr.CoT without residual feature steering on AIME 2026 using Qwen3.5-9B. For Vanilla, we varied only the total token budget, keeping the paper’s decoding settings and final-answer protocol. All results are averaged over four samples per question.
Table 1. Fixed-budget and coverage-guided stopping on Qwen3.5-9B and AIME 2026.
Increasing the fixed budget produced longer outputs, yet accuracy plateaued and then declined, a pattern consistent with overthinking. At the closest mean generation length (only 124 tokens apart), Dr.CoT (w/o steering) achieved 4.17 percentage points higher accuracy than the 28,672-token baseline. This result supports using the coverage ratio and coverage gain to determine when to stop reasoning for each question.
We hope our responses and the additional evidence have addressed your concerns. We sincerely thank you again for your constructive feedback, which has helped us strengthen the evaluation and presentation of our work.