- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies fit-set poisoning in OPQ-based Semantic-ID recommender systems. By injecting items into the data used to fit the OPQ tokenizer, an attacker can substantially change the Semantic IDs of legitimate items. The paper evaluates this effect across multiple recommenders, datasets, encoders, and attack settings, and further studies downstream recommendation impact and possible defenses.
Critical strengths
-
The paper identifies the tokenizer fit set as an underexplored security boundary in generative recommendation systems.
-
The study covers multiple recommenders, datasets, text encoders, attack strategies, and realistic text-based poisoning.
Critical weaknesses
-
The threat model does not fully explain how the attacker can actually poison the fit set. This is probably my biggest concern. In the evaluated pipelines, the fit set consists of items that appear in the training interaction data. However, the attacker is assumed to control only injected items and cannot manipulate user interaction histories. In other words, simply uploading a malicious product is not the same as getting that product into the fit set.
-
The paper demonstrates strong tokenizer corruption, but not a reliable end-to-end recommendation attack. The main empirical result is that poisoning can substantially change the Semantic-ID structure. However, this does not consistently translate into recommendation degradation. Among the nine recommender–dataset settings, only three show significant downstream changes, and one of them actually improves recommendation quality. Increasing the poisoning budget also does not consistently increase the damage. This makes it unclear what the practical security impact is.
-
A large part of the observed effect may reflect inherent OPQ instability rather than a specifically adversarial effect. The benign-growth experiments show that simply adding normal catalog items can produce structural drift comparable to malicious poisoning. The paper itself concludes that this sensitivity is a broader property of OPQ refitting rather than a uniquely malicious signature. This weakens the interpretation of the results as an attack.
-
The attack also has limited controllability. Although the proposed poisoning can cause large global changes in the Semantic-ID structure, even the “cluster-targeted” attack does not damage the intended cluster more than the rest of the catalog. The authors’ own localization analysis finds no significant targeting effect. As a result, the attacker can disrupt the tokenizer, but cannot reliably control which items are affected or what downstream recommendation behavior will result. This makes it unclear what concrete attacker-chosen objective the proposed attack can actually achieve.
Questions for authors
see Weaknesses
5 comments
Q2. End-to-End Recommendation Impact
We thank the reviewer for raising the question of practical security impact. In the revised manuscript, we clarify the distinction between tokenizer-level disruption and downstream recommendation effects, supported by additional matched-benign comparisons, clean-refit controls, and statistical analysis (Sections 5.2–5.3; Appendix C).
Downstream impact.
Across nine recommender–dataset settings, three exhibit nominally significant NDCG@10 changes: −11.5% (DiffGRM/Sports), −4.0% (TIGER-style/Beauty), and +5.2% (TIGER-style/Toys). None survives Holm correction across the nine comparisons (minimum adjusted p=.163; Table 14).
The budget analysis reveals a more consistent negative direction for leverage poisoning, which reduces NDCG@10 by 10.5%, 11.6%, and 5.7% at 5%, 10%, and 25% budgets, respectively. Although the magnitude is non-monotonic, degradation occurs at all three budgets (Table 17).
Attack-specific effects versus ordinary refitting.
At k=121, leverage poisoning produces a 17.7% NDCG@10 reduction relative to the pre-update tokenizer (nominal p=.005, Holm p=.051), compared with 10.9% under matched benign growth. The direct attack-minus-benign difference is −7.6% [−22.9%, +7.7%] (Holm p=.662; Tables 2 and 16). These matched comparisons quantify the additional effect relative to ordinary catalog growth, although the difference is not statistically significant.
End-to-end validation.
We additionally evaluate attacker-controlled listings admitted through five attacker accounts, with PCA and OPQ refitting followed by recommender retraining. Relative to matched real listings, 40 HotFlip items produce −3.1% NDCG@10 (95% CI [−20.4%, +14.1%]), while 121 text-mimicry items produce +3.6% (95% CI [−25.9%, +33.0%]; Table 18). These experiments establish that the poisoning mechanism operates through the full pipeline, while the observed downstream differences remain statistically inconclusive.
Practical security implications.
Importantly, the attack's effects extend beyond Semantic-ID reassignment. At matched update sizes k=121 and k=605, poisoned items exclusively occupy 0.50–5.25 codewords per digit, versus at most 0.25 under benign growth. Random and cluster-targeted poisoning also increase legitimate-item reconstruction error to 0.6266–0.6312, compared with 0.6236–0.6256 for benign additions (Table 1).
Our findings establish measurable adversarial effects on OPQ quantizer capacity and reconstruction quality, while distinguishing them from downstream ranking changes that are not statistically established as poisoning-specific. The security contribution therefore includes identifying this tokenizer-level vulnerability and evaluating protections at the refitting boundary.
Q3. Adversarial Poisoning versus Benign OPQ Instability
We thank the reviewer for highlighting the need to distinguish adversarial poisoning from inherent OPQ refitting instability. Our revised analysis explicitly separates Semantic-ID reassignment caused by ordinary refitting from additional effects induced by attacker-controlled items (Sections 5.1–5.2).
Distinguishing poisoning from benign instability.
Clean refits caused by changes in FAISS seeds, item order, or fit-set membership already produce substantial Semantic-ID reassignment (tuple ARI approximately 0.38–0.49). Similarly, poisoning and matched benign additions exhibit overlapping ARI ranges. We therefore use matched additions to examine whether adversarial items produce effects beyond this inherent instability.
Evidence of attack-specific effects.
Table 1 provides a direct comparison at identical update sizes:
| Budget | Exclusive codewords/digit (benign) | Exclusive codewords/digit (poison) | Reconstruction error (benign) | Reconstruction error (random/cluster poison) |
|---|---|---|---|---|
| k=121 | 0 | 0.50–2.25 | 0.6236–0.6251 | 0.6266–0.6281 |
| k=605 | 0–0.25 | 2.50–5.25 | 0.6247–0.6256 | 0.6281–0.6312 |
The exclusive-codeword ranges cover random, cluster-targeted, and leverage poisoning; reconstruction-error ranges cover random and cluster-targeted poisoning.
These results reveal two distinctions. First, poisoned items occupy codewords no longer used by legitimate items, whereas matched benign additions exhibit negligible exclusive occupancy. Second, random and cluster-targeted poisoning consistently produce higher legitimate-item reconstruction errors than matched benign growth at both budgets. Thus, the observed adversarial effects extend beyond Semantic-ID reassignment alone.
End-to-end validation.
We additionally verify this distinction using attacker-controlled listings admitted through the interaction-based mechanism. With 40 HotFlip items, exclusive codeword occupancy reaches 1.50 per digit, versus 0 for 40 matched real listings. With 121 text-mimicry items, the corresponding values are 0.50 versus 0 (Table 13). These experiments demonstrate that the structural differences can also arise when injected items enter through the actual fit-set admission process.
OPQ instability constitutes the attack surface, but the measured quantizer-capacity capture and increased reconstruction error distinguish the evaluated poisoning attacks from ordinary benign catalog growth. This distinction is now explicit in Sections 5.1–5.2 and Table 1 of the revised manuscript.
Q1. Threat Model and Practical Fit-Set Admission
We thank the reviewer for the opportunity to clarify how attacker-controlled items enter the tokenizer fit set. We clarify the assumed fit-set membership in our original experiments and provide new end-to-end validation showing how attacker-controlled items can enter the fit set through attacker-generated interactions (Section 3.1).
Threat model and admission mechanism.
In the studied pipelines, the fit set M comprises items appearing in training interactions. The original experiments assume that attacker-controlled representations can be inserted directly into the OPQ fit set after clean PCA, isolating tokenizer-level effects. In the end-to-end setting, the attacker creates its own accounts and interacts with its newly listed items, without modifying legitimate users' histories. These interactions satisfy the pipeline's admission rule, yielding M′=M∪P.
End-to-end experimental validation.
On DiffGRM/Beauty, we introduce five attacker-controlled accounts, each interacting with all k injected items. Every injected item consequently receives five interactions, satisfying the dataset's 5-core filtering requirement. Each attacker account also satisfies this requirement. The injected items enter the training sequences, recommender vocabulary, and tokenizer fit set. PCA and OPQ are then refitted, followed by recommender retraining (Appendix A.6).
The five accounts represent 0.02% of users, contributing 0.1% and 0.3% of real interaction volume at k=40 and k=121, respectively.
Experimental results (Table 13).
All injected items successfully enter the fit set. Matched real listings follow the identical admission procedure, holding the interaction pattern fixed while varying the added items. Both attacks induce substantial legitimate-item Semantic-ID reassignment and occupy codewords unused by legitimate items, whereas matched real listings occupy no exclusive codewords at these budgets.
We further verify complete fit-set admission at attack budgets of 5%, 10%, and 25% of the original catalog size (Table 13; Appendix B.9), with structural effects evaluated at these larger budgets.
In summary, the end-to-end experiment establishes a feasible route for satisfying the dataset's fit-set admission rule through attacker-generated interactions, without modifying legitimate user histories.