- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Reason in Style, a framework for discovering and controlling stylistic variation in mathematical reasoning traces. It learns disentangled content and style representations, identifies recurring styles through clustering, and trains student models using style-conditioned fine-tuning with importance weighting. Experiments across multiple mathematical reasoning benchmarks demonstrate improvements in Pass@k.
Critical strengths
- The paper addresses an important and relevant problem in LLM research, particularly regarding reasoning diversity and controllability.
- The paper is clearly written and easy to follow, with a well-structured presentation of the motivation and proposed method.
- The empirical evaluation is reasonably comprehensive, covering multiple benchmarks and model sizes. The additional analyses provide interesting findings on the relationship between reasoning styles and problem-solving performance.
Critical weaknesses
-
The distinct motivation for style-specific control could be clearer. The paper offers an interesting perspective on stylistic variation, but its practical motivation overlaps with existing work on preserving reasoning diversity and improving mode coverage, such as ModC [1] and SSFT [2]. Although discovering stylistic structure is potentially valuable, the main downstream benefit is demonstrated through mixed-style Pass@k, which also measures the effectiveness of covering complementary solution modes (§5–§6). A clearer explanation of what style discovery and control enable beyond general reasoning diversity (and in which settings this distinction matters) would make the significance of the problem formulation more compelling.
-
The comparisons could better reflect alternative approaches to exploiting reasoning diversity. The baselines primarily cover vanilla SFT and random-, teacher-, or discovered-style conditioning (§5.1). Comparisons with ModC’s gradient-based mode discovery [1] and SSFT’s mode-preserving training [2] would help position the method against closely related alternatives. In my opinion, another potentially relevant direction is gradient-based data diversification, as explored in Prismatic Synthesis [3], which identifies underrepresented modes through gradient-based clustering and selectively incorporates newly generated samples to improve training-data diversity. Although its data-expansion setting differs from the fixed-corpus setting considered here, a baseline adapting its core idea of gradient-based clustering and diversity-aware rebalancing to the same experimental setting could provide a useful comparison. Even if such an empirical comparison is not feasible due to differences in their settings, a more explicit conceptual comparison or discussion of these approaches would offer additional insights into how the proposed method relates to broader approaches for exploiting reasoning diversity.
-
The interpretation of the discovered clusters as styles could be more precisely justified. The method encourages content representations to agree across traces answering the same question, while style representations capture complementary trace-level variation (§3). However, solutions to the same question can differ in mathematical strategy as well as presentation, and the paper includes verification and backtracking within its notion of style. This leaves some ambiguity about whether the discovered clusters capture expressive styles, broader reasoning modes, or a mixture of both. The successful recovery of four prompted writing styles provides useful evidence in the controlled setting (§4.1). A more explicit operational definition of style, together with a clearer justification for extending this interpretation to the natural multi-teacher clusters, would strengthen the paper’s central claims about content–style separation.
[1] Wu et al., Mode-Conditioning Unlocks Superior Test-Time Compute Scaling, ICLR 2026.
[2] Jia et al., Training Large Language Models to Reason in Parallel with Global Forking Tokens, ICLR 2026.
[3] Jung et al., Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning, NeurIPS 2025.
Questions for authors
-
I would be interested in the authors' perspective on whether style discovery and conditioning could be further developed to enhance the model's exploration capabilities during reasoning, rather than merely increasing diversity across independently generated solutions.
-
Given that the current study focuses on mathematical reasoning with verifiable answers, I would also be interested in the authors' perspective on whether this approach could be effectively extended to domains where correctness cannot be objectively verified, and what challenges might arise in such settings.
General response
We thank all reviewers for their thoughtful feedback! We have incorporated their suggestions in our revised manuscript:
In the introduction, we clarify that we view style as how a solution is expressed, including its presentation and the reasoning strategy it uses. We also strengthen the motivation for our work in the third paragraph of the introduction.
We have expanded the experiments and analysis in response to the reviewers’ questions. These additions include:
We have added the following discussion points in Section 7:
We are grateful for the reviewers' feedback, which helped us improve the manuscript’s clarity.