- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates "path-load imbalance" in dense Transformers during supervised fine-tuning, showing that attributional load (measured as C = E|a·g|) can concentrate on a small subset of MLP neurons, residual dimensions, and attention heads and that this concentration is causally load-bearing and predictive of forgetting on math tasks. Building on this diagnosis, the authors propose PATHBALANCE, a simple training intervention that, at every update, measures per-unit attribution load on the current batch, masks the currently hottest units (top 2% of MLP/residual coordinates; 12.5% of heads), and optimizes cross-entropy on the same data with the masked network. Across five Qwen/Qwen3.5 models and three math benchmarks, PATHBALANCE improves over matched SFT baselines by large margins (up to +50 pp on MATH subjects) without any inference-time change, with ablations indicating that load-based selection—not dropout per se—drives the gains and redistributes load from previously overloaded to cold units.
Critical strengths
- The paper is generally well written and clearly organized, with a coherent logical flow that makes it easy to follow.
- The diagnostic experiments are convincing. The authors not only observe that the load in the MLP, residual, and attention modules gradually becomes concentrated, but also conduct intervention experiments to further demonstrate that these hot units are indeed important for model performance.
Critical weaknesses
- All major experiments appear to use only a single training seed. Although the paper reports confidence intervals over test samples, these intervals do not capture the randomness of the training process. It would be helpful to report results from multiple runs for several representative settings.
- Each update requires an additional forward and backward pass to compute the load, which roughly doubles the training cost. This overhead may become substantial when scaling to larger models.
- The choice of a 12.5% head mask versus a 2% neuron/residual mask is motivated by the diagnostic results (e.g., top-3 out of 32 heads), but a clearer justification for these specific ratios, as well as a discussion of how they were tuned, would strengthen the paper.
Questions for authors
- Have you tried stronger SFT baselines, such as using a smaller learning rate or stronger regularization? Does the nearly 50-percentage-point improvement still hold under these stronger baselines?
- Section 3.6 suggests that stable-hot neurons are beneficial, while newly-hot neurons are more likely to be harmful. If so, why does PATH BALANCE still directly mask all currently hot neurons?
- Beyond mathematics, could you evaluate the method on non-mathematical domains, such as summarization or factual verification, where the reasoning structure is less pronounced? Do you observe similar load concentration patterns and performance gains in these settings?
4 comments
Response to Reviewer x5Hx (continued)
Q1: Have you tried stronger SFT baselines, such as a smaller learning rate or stronger regularization? Does the nearly 50-point improvement still hold?
Yes. We ran SFT with learning rates 1e-5 and 5e-6 on both Qwen3-1.7B and Qwen3-4B, and with 10× weight decay on Qwen3-1.7B, each with all six PathBalance settings at the same learning rates (Tables C, D).
- Stronger regularization does nothing: SFT with weight decay 0.1 scores 15.95%, the same as the paper's SFT.
- On Qwen3-1.7B, SFT is substantially more sensitive to learning-rate changes than PathBalance. SFT accuracy varies by 22.92 points across seeds and learning rates, compared with at most 4.54 points for any PathBalance setting. Every SFT run (15.95–38.87%) remains below every PathBalance run (53.27–57.81%) (W1).
- On Qwen3-4B, smaller learning rates improve SFT but do not recover initial-model performance. SFT achieves 63.01% at LR 1e-5 and 66.45% at LR 5e-6, remaining below the initial model (77.63%). In contrast, PathBalance consistently achieves 78.63–81.84% across the tested learning rates, preserving or improving upon initial-model performance (W1).
Thus, while the approximately 50-point improvement reflects the shared training recipe, the advantage of PathBalance persists after learning-rate tuning. Across three learning rates on Qwen3-4B, SFT accuracy varies by 36.00 points, compared with only 0.33–2.11 points for each PathBalance setting. Table A in the General Response shows the symptom: SFT's outputs shrink toward the length of the short gold solutions. We will report these tuned baselines in the paper.
Q2: Section 3.6 suggests that stable-hot neurons are beneficial while newly hot neurons are harmful. Why does PathBalance still mask all currently hot neurons?
The mask lasts one update and is absent at inference, so stable-hot neurons stay in the network and keep their function at test time; the mask only keeps that update from being routed through them:
- A masked unit receives no gradient from that batch. For a masked MLP neuron, its rows of W_gate and W_up and its column of W_down get zero gradient from the batch; for a masked head, its query projection and its slice of W_O do. That batch's update is therefore carried by the rest of the network instead of loading the stable-hot neurons further, in line with Section 3.6, which finds stable-hot neurons useful.
- Newly hot neurons are masked as soon as they become hot, which counters the concentration that Section 3.6 identifies as harmful; Table 3 shows load moving to previously cold neurons.
- Telling the two apart requires history. Classifying a neuron as stable-hot or new-hot needs a reference checkpoint, a history window and a threshold. Masking the current top 2% is stateless and needs none of these.
We will add this explanation to Section 4.1.
Q3: Beyond mathematics, could you evaluate on non-mathematical domains, such as summarization or factual verification? Do you observe similar load concentration patterns and performance gains?
We added code generation (APPS; Table E in our reply to ozPY) and dialogue summarization (SAMSum), each with all seven settings.
- Load concentration extends beyond mathematics. On the initial model, the top 2% of MLP neurons carry 14.0% of the load on APPS and 16.5% on SAMSum, compared with 13.5–14.5% across the three math tasks (uniform: 2%). This concentration increases to 50.7–62.4% in the final layer across these tasks.
- Code: the same pattern as mathematics. SFT reduces APPS accuracy from 14.22% to 7.50%, whereas all six PathBalance settings achieve 14.02–15.24%, outperforming SFT by 6.52–7.74 points under an execution-based scorer.
- Summarization: PathBalance improves upon SFT without initial-model degradation. On SAMSum (5,000 training dialogues, 819 test dialogues, ROUGE-L, one seed), SFT improves the initial model from 29.56 to 37.60. Importantly, PathBalance further improves performance: H achieves 41.80 (+4.20 over SFT), M achieves 39.85 (+2.25), and M+H achieves 38.70 (+1.10). Configurations involving residual-dimension masking remain near initial-model performance (R 29.61, M+R 29.71, M+R+H 29.33).
These results clarify PathBalance's scope. On math and code tasks, where SFT degrades initial-model performance, PathBalance preserves reasoning performance and maintains accuracy close to or above the initial model. On summarization, where SFT improves performance, masking hot MLP neurons or attention heads yields further gains, demonstrating effectiveness beyond mathematical reasoning. These findings highlight the value of targeted load redistribution across tasks. Residual-dimension masking exhibits task-dependent behavior, which we will discuss alongside masking-site selection in the revised paper.
We hope these experiments address your concerns about the baseline, robustness, scope and mechanism; if so, we would be grateful if you would consider raising your score.
Response to the Authors
I appreciate the authors' thorough response. The provided explanations have resolved my initial concerns.
Response to the Reviewer
Dear Reviewer,
Thank you for your positive feedback. We are pleased that our response has addressed your concerns and sincerely appreciate your time and consideration.
Best regards,
The Authors
Response to Reviewer x5Hx
Thank you for the careful review, and for finding the paper "generally well written and clearly organized" and the diagnostic experiments "convincing." We address each point with new results. Tables A–D are in the General Response, which also introduces one-pass PathBalance: no extra pass, about SFT's step time, and the same accuracy as two-pass (details under W2 below).
We trained all seven settings with two additional seeds on Qwen3-1.7B Intermediate Algebra, and also at two smaller learning rates (Table C). Over the three seeds:
Two-pass PathBalance costs about 2× per step, as the paper states (Section 4.1 and the cost appendix), but the extra pass is not required (first point below). Peak memory rises by only 0–4.5 GiB (0–14%) in our runs, because the measurement pass keeps no optimizer state and the two graphs are not held together. Inference is unchanged. Three points put this cost in perspective:
The ratios were not tuned: one setting is used for all 5 models and the 3 paper datasets, and unchanged for the 4 new tasks and the Base model.