- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates what LLM pretrained initialization contributes to recommendation. It argues that recovering general-task performance does not bring clear additional recommendation gains, while recommendation still depends on task-shared neurons. Based on this, the paper proposes an initial localization-guided neuron recombination method: it first identifies candidate channels based on FFN channel activations on recommendation contexts at initialization, then performs recommendation SFT, and finally freezes the SFT backbone while training only a low-rank residual recombination module applied to the selected channels.
Critical strengths
1,The paper is generally well written, and the method, experimental setup, and main findings are relatively easy to understand.
2,The experiments are relatively extensive. The method achieves consistent, though limited in magnitude, improvements over standard recommendation SFT across multiple metrics.
Critical weaknesses
1,Section 3.2 presents a two-factor FFN with fixed directions, linear readout, and gradient-flow analysis, leading to Propositions 1 and 2. However, the actual module is a low-rank residual applied to a frozen SFT backbone, rather than the two-factor update assumed by the theoretical model.
2,The ablation studies are insufficient: the method’s gains may also stem from additional low-rank parameter capacity, the second-stage single-target SID supervision.
Questions for authors
How large is the drift of the initially localized channels after SFT? Is re-localization after SFT equally effective?