- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
LASAR brings Coconut-style recurrent latent reasoning into SID-based generative recommendation. The last-layer hidden state is fed back as the next input embedding for N steps before the item SID is decoded (Eq. 3). Training runs SFT then RL, with three designs.
- Two-stage SFT: Stage 1 grounds SIDs with plain cross-entropy, and only Stage 2 adds the latent loop (Fig. 4).
- Step-wise bidirectional KL alignment: each latent step is aligned to a fixed anchor, namely the Stage-1 hidden state at a segment boundary of a GPT-5 CoT trace segmented by embedding similarity (Eq. 4).
- A Policy Head predicting per-sample depth N: it is CE-warm-started on the segment counts, then trained with REINFORCE and a step penalty alongside GRPO and a terminal-only KL (Eq. 5).
With Qwen3-0.6B on Amazon Beauty/Instruments/Sports and Steam, LASAR is best on 23 of 24 metric–dataset cells of Table 1. The baselines are SASRec, GRU4Rec, LC-Rec, MiniOneRec, ReaRec and a direct-answer GREAM variant. Inference overhead is 7–16% over MiniOneRec (Table 4). The paper also reports alignment and RL ablations (Tables 2, 3, 9), depth analyses (Fig. 5, 9) and a 1.7B LoRA scaling point (Table 5).
Critical strengths
- A well-designed adaptation of latent reasoning to SID-based generative recommendation. The paper identifies why Coconut-style latent reasoning fails out of the box in SID-based recommenders: SIDs carry no pretrained semantics, so jointly learning them with latent reasoning converges poorly (Fig. 4). Two-stage decoupling and alignment to CoT anchors address this directly. The implementation is also carefully engineered for beam-search recommendation:
- the hidden-state feedback loop reuses the KV cache;
- variable-depth samples are batched with masking;
- predicting N before the loop lets all beams of a prompt share the same depth;
- decoding is trie-constrained (§2.2, App. E). Unaligned latent reasoning can even fall below plain SFT (Instruments N@10 0.0576 vs 0.0634, Table 9), while KL alignment improves results on all four datasets (Tables 2, 9). The ablations expose these failure modes rather than hiding them, which makes the design choices convincing.
- Consistent gains at near-zero inference cost, with practical relevance. All generative baselines share the base model, prompt, SID tokenizer and training data, and the GREAM variant uses the same CoT traces (§3.1, App. D/E). Under that control LASAR is best on 23 of 24 cells of Table 1, including the non-Amazon Steam dataset. It adds only 7–16% GPU-seconds per sample over MiniOneRec (Table 4), and REINFORCE cuts mean depth from 4.20 to 2.47 while improving quality (Table 3). Inference cost is the main barrier to using LLM reasoning in production recommenders, so adding reasoning without generating text addresses a practically important problem.
Critical weaknesses
-
Baseline consistency and statistical robustness. The MiniOneRec numbers in Table 1 are lower than the paper's own "Pure SFT" model (Table 9) on three datasets:
- Sports HR@10: 0.0260 vs 0.0237.
- Instruments HR@10: 0.0888 vs 0.0826, which is also above GREAM's 0.0850.
- Steam N@10: 0.0372 vs 0.0357.
The source of this gap must be clarified. Against the stronger numbers, LASAR's margins shrink substantially (e.g., Sports HR@10 from about +18% to about +8%). On Sports, KL-aligned SFT alone (HR@10 0.0281) already matches the full LASAR (0.0280), so the RL stage's contribution there is unclear. On Beauty, gains over the best baseline are small (N@10 0.0303 vs 0.0295) and only p < 0.1.
The size of the gain also varies widely across datasets, and the paper's explanation (larger gains under higher sparsity, §3.2) is contradicted by its own data. Steam is the densest dataset (sparsity 99.468%) yet shows large gains (+9.2% N@10 over the strongest baseline). Beauty is sparser (99.935%) but shows the smallest. Notably, Beauty is the only dataset where the Table 1 MiniOneRec is stronger than the Table 9 "Pure SFT" (N@10 0.0295 vs 0.0277). Part of the cross-dataset variation may therefore reflect baseline strength rather than properties of the data. All results appear to be single training runs: the bootstrap in App. C resamples test users and does not capture training variance, and no validation split is described for selecting λ or checkpoints.
-
The efficiency claims lack matched comparisons and full cost accounting.
- The fixed-depth results (Fig. 5a, Fig. 9) force N on a checkpoint trained under adaptive N (App. G), so the fixed depths are out of distribution for that model. This does not show that adaptive allocation beats a model trained at a fixed depth. Fixed N = 1 on the same checkpoint is already close to adaptive.
- The batch loop runs to max(N) with masked padding (App. E.1), so a lower mean N does not by itself imply less executed computation.
- The "over 20× faster than explicit CoT" claim compares latency against GREAM's CoT-generation mode (Table 4), but accuracy against its direct-answer mode (Table 1). The accuracy of the CoT-generation mode is never reported.
- The method needs a GPT-5 trace for every training sample (App. E.2), yet the cost of generating them (API spend or time) is not reported. This offline cost matters for deployment, especially when the model is retrained often.
Questions for authors
- Why is the Table 1 MiniOneRec weaker than the Table 9 "Pure SFT" on Sports, Instruments and Steam (e.g., RL stage, hyperparameters, epochs)? Would the conclusions change if the stronger of the two were used as the baseline?
- What explains the large variation in gains across datasets, given that sparsity does not account for it (Steam vs Beauty)? An analysis by user or item characteristics (e.g., history length, category diversity, item popularity) on existing outputs would help readers judge when LASAR is worth using.
- What was the cost of generating the GPT-5 CoT traces (number of traces, API spend or time)? How sensitive is LASAR to the teacher model, e.g., with a smaller open-source teacher?
2 comments
Thank you for the detailed response. It addresses many of my questions, including the Pure SFT comparison, the RL contribution on Sports, and the trace cost and teacher sensitivity. I will maintain my original assessment. Thank you for your efforts.
Dear Reviewer kkKD,
With less than one day remaining in the discussion period, we would like to kindly follow up, as we have not yet received your feedback on our responses. We would appreciate knowing whether our clarifications and additional results address your concerns, or whether any points require further explanation. We remain available to clarify them before the discussion closes.
Thank you again for your thoughtful review and time.
Best regards, The Authors