acceptodds
Under review as a conference paper at ICLR 2027

Item Content Helps the Long Tail but Hurts Popular Items in Sequential Recommendation under a Lexical Encoder: Frequency-Gated Content Injection

Abstract

Item content is widely used to help sequential recommenders rank long-tail items, yet its effect on popular items is rarely isolated. On three Amazon Reviews 2023 categories, uniformly injecting item titles and categories into a SASRec backbone through a fixed lexical content encoder raises long-tail Recall@10 by 10.6–17.8 points but lowers head Recall@10 by 1.7–4.5 points. This head cost is specific to the lexical encoders we test: with a frozen semantic encoder at 768 dimensions, it disappears in all three categories. Frequency-conditioned fusion weights have been explored in recent multimodal and long-tail recommenders; we study a minimal single-scalar form, Frequency-Gated Content Injection (FGCI), where a per-item scalar α_i scales the content embedding and is learned jointly with the backbone from the item's frozen, standardized log interaction count. FGCI improves head Recall@10 over the no-content baseline in all three categories, while long-tail Recall@10 stays 8.4–15.8 points above it. A natural explanation is that FGCI simply injects more content; we rule this out. A constant scale fixed a priori at the head-item level misses FGCI by 5.1–6.0 points (unpaired p < 0.01 in all three categories). Nor can the gate be fitted after the backbone has been trained. An ablation on Health and Household, one of the three categories, shows the same for training-time gating alone: it drives head Recall@10 23.8 points below the no-content baseline. Together, these controls show that the gain is not reproduced by any unconditional, post-hoc, or single-sided variant we test. What, then, does the gate learn? In all three categories the learned α_i is largest for head items and smallest for long-tail items, inverting the intuition that the items with the least interaction history need the most content. That inversion does not explain the recovery either: head items keep 85–88% of their content weight under the gate, yet a constant scale at that value does not recover head performance at all. This rules out the most natural static-weight reading of the gate and indicates that the recovery requires conditioning to be per item and learned jointly, rather than residing in the specific gate values. Why this conditioning helps remains an open question that our controls have narrowed but not resolved.

Primary area:
other topics in machine learning (i.e., none of the above)
Keywords:
sequential recommendation, long-tail recommendation, content-based recommendation, popularity bias, content injection, gated fusion, frequency-conditioned gating, head-tail trade-off

Reviews

Among:
Shape:
1234this paper, Bottom 10%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.67 over 3 reviews, above 10% of the others.
Reviewer_DoaaOpenReview ↗
Rating
2
Confidence
4
Informativeness
3
Presentation
3
Soundness
3
Read review
Paper summary

The paper reveals that injecting lexical item content into a SASRec sequential recommender improves long-tail Recall@10 by 10.6–17.8 points but harms popular head items by 1.7–4.5 points—a cost specific to lexical encoders that disappears with semantic encoders. To mitigate this trade-off, the authors propose Frequency-Gated Content Injection (FGCI), a minimal 49-parameter gate scaling content embeddings via an item's frozen log interaction count. Its primary contributions include exposing this stratified head-tail conflict, introducing FGCI to recover head Recall@10 (+1.2 to +4.1) while preserving tail gains, and isolating through strict controls that recovery demands per-item, frequency-conditioned, jointly learned gating rather than static or post-hoc re-weighting. FGCI is validated across three Amazon 2023 datasets (Health, Grocery, Beauty) across paired random seeds, confirming head performance recovery while highlighting the counterintuitive empirical finding that popular head items receive the largest content weights.

Critical strengths

The paper’s primary strength is its refusal to buy into aggregate-metric optimism, looking past top-line averages to reveal that naive lexical content injection actively degrades performance on popular head items by up to 4.5 Recall@10 points. This insight is highly consequential as it exposes a prevalent blind spot in sequential recommendation benchmarks that standard macro-evaluations mask. Equally impressive is the authors' airtight experimental hygiene: using a suite of surgical control arms—such as permuted frequency inputs, frozen post-hoc tuning, and constant-scale baselines—they systematically eliminate alternative explanations, proving that FGCI’s head recovery is not a trivial dose effect or parameter cushion, but strictly requires per-item, jointly learned frequency gating.

Critical weaknesses

While the paper's execution is admirably thorough, its central weakness is that the diagnosed head-item penalty is largely a self-inflicted artifact of using a simplistic, hash-based lexical encoder. As the authors candidly demonstrate, switching to a standard 768-dimensional semantic encoder causes the head penalty to vanish across all domains—rendering the core problem (and thus FGCI's rescue mission) largely moot for modern pipelines that rely on dense representations. Additionally, while FGCI successfully recovers performance, the paper leaves the underlying mechanism an open puzzle, presenting a head-heavy weight distribution that inverts domain intuition without offering a satisfying theoretical explanation for why it works.

Questions for authors

(1) Does the head-item penalty persist under other sequential architectures (e.g., BERT4Rec) or non-hashed lexical representations, or is FGCI strictly a rescue patch for SASRec + CRC32 hashing?

(2) Given that dense semantic encoders already eliminate the head penalty entirely, what real-world system constraints would force practitioners to rely on shallow lexical hashes where FGCI is necessary?

Reviewer_5fFYOpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

This paper examines the impact of item-content injection across different popularity tiers in sequential recommendation. It uncovers a notable popularity-stratified effect, but the suggested remedy seems modest, and the core effect diminishes considerably when a more powerful content encoder is used. Although it offers a thorough empirical analysis, the paper reads more like a targeted diagnostic investigation than a broadly applicable or genuinely new recommendation approach.

Critical strengths
  1. The paper demonstrates that injecting lexical content without conditions can boost overall performance, but at the same time it hurts performance on popular target items. This is a valuable finding that could guide both model development and evaluation practices.

  2. The approach is straightforward and computationally efficient, with multiple carefully designed controls, including permuted frequency inputs, post-hoc gates, training-only gates, and fixed scaling factors.

  3. The paper presents thorough findings, including per-run gate summaries and surprising outcomes, and shows a consistent trend across the three evaluated categories.

Critical weaknesses
  1. The study considers just a single recommender backbone and one dataset family, and the head-item degradation mostly vanishes when the semantic encoder is frozen, which undermines the central motivation.

  2. The study evaluates only two meaningful constant settings, and the primary assessment relies on just 100 sampled negative examples.

  3. The underlying mechanism is still unclear, especially the reason popular items are assigned higher content weights.

Questions for authors

Q1: Are the reported gains preserved under full-catalog ranking?

Q2: Do the same results hold under BERT4Rec, GRU4Rec, or a non-attention sequential recommender?

Reviewer_KPCQOpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

This paper examines how item content affects recommendation performance differently for popular and long-tail items. The authors implement experiments on three datasets from Amazon Reviews 2023 to show that uniformly injecting title and category information into SASRec through a lexical encoder improves performance on long-tail items but degrades it on popular items. To address this trade-off, the authors proposed a method called FGCI, which generates per-item content weights from interaction frequencies and is trained jointly with the recommendation model. FGCI recovers performance on popular items while retaining most of the gains for long-tail items.

Critical strengths

The empirical study provides an interesting and valuable observation: under the tested lexical encoder, injecting item content can hurt recommendation performance on popular items while benefiting long-tail items.

Critical weaknesses
  1. Do the observed phenomenon and proposed approach generalize to other datasets? The experiments currently use Amazon Reviews, whereas many other recommendation datasets may not provide comparable item content. Could the authors also discuss whether such content is readily available and practically usable in real-world recommendation scenarios?
  2. The conclusion from this paper, which claims the contents are harmful for the popular items seems to come from the results of recall@10. On the beauty dataset, ndcg seems to increase. Can the author explain the reasons?
  3. The experiments are limited to SASRec, although the proposed framework appears applicable to other sequential recommendation architectures. Could the authors evaluate FGCI on additional backbone models to assess its effectiveness and generalizability across architectures?
  4. To be honest, i think the methods the authors proposed is a little bit too trivial and nothing interesting...Maybe I didn't fully understand. If possible, can the authors explain about the methods' novelty? Or the novelty is mainly on the observation experiments? The main methods also seems like an observation experiments....
  5. The related work discusses several approaches to long-tail recommendation, but the experiments do not compare FGCI with these methods and are limited to variants of SASRec. While this controlled setup helps isolate the effect of content injection, it provides insufficient evidence of FGCI’s advantages over existing approaches. Could the authors include representative long-tail recommendation baselines under comparable settings and report performance separately for popular and long-tail items? Without such comparisons, it remains unclear whether existing methods already mitigate the observed trade-off and what additional benefits FGCI provides.
Questions for authors

See Weaknesses

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.