- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes LaneRoPE. LaneRoPE extends RoPE with an additional lane dimension to train models to use information from other reasoning paths. Experiments show improvements in majority-voting accuracy for the 7B model, with little additional inference latency.
Critical strengths
1.Simple and practical design. LaneRoPE extends positional encoding to both token and lane dimensions while preserving within-lane positional relationships. It can be integrated into pretrained models with minimal architectural changes.
2.Low inference overhead. The method introduces relatively few additional parameters and enables cross-lane information sharing with negligible inference latency overhead.
Critical weaknesses
1.The mechanism of cross-lane collaboration is not sufficiently analyzed. For the 7B model, moving from independent generation to four-lane collaboration barely changes the average individual accuracy, while majority-voting accuracy improves from 63.0 to 64.1.
2.The conditions under which collaboration is beneficial remain unclear. With the same KTO-trained LaneRoPE model, four-lane collaboration improves the 7B model's average maj@4 from 63.0 to 64.1 but reduces the 1.5B model's score from 52.4 to 51.3. These results suggest that the effectiveness of collaboration depends on model capacity and training strategy.
Questions for authors
1.When one lane provides correct evidence or incorrect reasoning, do other lanes use it to correct their reasoning or simply follow it? In particular, when only a minority of lanes are correct, does collaboration improve or hurt the final result?
2.Why does four-lane collaboration improve the 7B model but hurt the KTO-trained 1.5B model? Is the degradation caused by the additional context or interference from other lanes?
2 comments
Thank you for the additional analysis. It helps explain the changes in answer distributions, although the collaboration mechanism and the degradation in the smaller model remain insufficiently understood. I will maintain my original rating of Weak Accept.
We thank the reviewer for highlighting the simple and practical design of our method as well as its inference efficiency. Below we try to address the reviewer's main concerns.
maj@4scores despite minimal individual accuracy changes and suggests LaneRoPE's learnt behavior goes beyond simple lanes agreement.Precisely, we compare independent generation (N=1) with joint generation (N=4) for the 7B LaneRoPE and Bridge models; see also Apx. D.4. For each set of 4 jointly generated answers to each question, the table below reports the fraction of them containing zero to four correct answers (averaged over the 4 maths benchmarks). Notably, Bridge KTO has an almost inverse trend with respect to LaneRoPE KTO, showing a clear increase in unanimous correct groups; improvements in
maj@4come mostly from reduced one-correct (minority correct) groups. Under SFT, LaneRoPE increasespass@4(less zero-correct cases) but also unanimity; again, Bridge shows a mostly inverted trend, with more minority answers but also reducedpass@4.W2 Dependency on model capacity and training Of course, training data and model capacity are key factors to determine the resulting collaboration capabilities as our results confirm. We observe this is orthogonal to the method adopted, as Bridge suffers from the same problem. Nevertheless, LaneRoPE's benefits still appear in the SFT regime, where its expressive attention to the full history enables learning more useful policies from the same data.
Q1 With correct lanes minority, does collaboration improve or hurt results? Do lanes simply follow each other? Our new analysis in Apx. D.4 suggests collaboration can recover from correct minority and LaneRoPE doens't learn to simply follow majority. We compare the full distributions of correct-answer counts under independent (N=1) and joint (N=4) generation on matched problems, with both LaneRoPE and Bridge. Under KTO, when four independent answers contain only one correct answer, joint generation produces more correct answers on average. While SFT models tend more toward agreement, LaneRoPE's joint generation more frequently produces correct answers where independent generation produced none, contributing to its higher
pass@4rate. See also W1.Q2 Why does cross-lanes collaboration hurt the 1.5B model with KTO? We suspect this to be a combination of model capacity and the model-dependent data filtering in KTO (we retain only problems with at least a solution and no more that 50% correct responses), because of which the 1.5B dataset includes typically simpler problems than the 7B-generated one. In this regime, we suspect learning a stronger independent strategy might be simpler than learning to use cross-lanes information. We will further investigate this aspect.