- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes precision-weighted attention (PWA) for sequential recommendation to account for unequal evidence supporting item representations. PWA maintains a per-token precision state that influences attention weights, residual updates, and propagation across layers. The filtering-inspired approach is evaluated on three recommendation backbones across six datasets.
Critical strengths
S1. Relevant and well-motivated problem. Item exposure varies substantially in the evaluated datasets, motivating a distinction between an interaction’s relevance and the reliability of its representation. Explicitly modeling this distinction is a meaningful direction for sparse recommendation.
S2. Interpretable design with minimal additional parameters. The combination of a layerwise precision state, a closed-form observation estimator, and precision-dependent residual gains is conceptually appealing. The derivation clearly states its assumptions, and only four added parameters receive gradients in the evaluated SASRec configuration.
Critical weaknesses
W1. The contribution of precision modeling is not sufficiently isolated. PWA also changes the residual pathway, positional bias, and dropout normalization, so the main comparisons evaluate a composite architectural modification. The matched control is limited to SASRec on two datasets with five seeds. Broader matched controls and simpler residual-gating baselines are needed to establish the specific advantage of the proposed precision mechanism.
W2. The reliability interpretation lacks direct validation and has a concrete implementation problem. The estimator’s assumptions do not hold for learned, correlated attention values, and ranking gains alone do not establish that precision measures reliability. More seriously, an attention row whose entries are all dropped receives maximum observation precision despite having no observation. This behavior requires correction and an experiment measuring its impact.
W3. The exposure prior complicates evaluation fairness. PWA’s exposure counts include validation-target identities, allowing validation-label information to influence model computation before checkpoint selection. Although this is not test-target leakage, it introduces an additional information channel. Disabling the entire prior does not isolate this effect; a training-only exposure-count comparison is needed.
Questions for authors
Please refer to the weaknesses.